-- Logs begin at Wed 2021-10-27 00:24:55 UTC, end at Wed 2021-10-27 01:38:25 UTC. -- Oct 27 00:59:32.421481 dv-cinder-815560-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 27 00:59:32 2021] *** Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: nodename: dv-cinder-815560-1-iscsi Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: machine: x86_64 Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: clock source: unix Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: pcre jit disabled Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: detected number of CPU cores: 4 Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: current working directory: / Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: detected binary path: /usr/bin/uwsgi-core Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: your processes number limit is 47680 Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: your memory page size is 4096 bytes Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: detected max file descriptor number: 2048 Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: lock engine: pthread robust mutexes Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: thunder lock: enabled Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 27 00:59:32.434654 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: Python version: 3.8.10 (default, Sep 28 2021, 16:10:42) [GCC 9.3.0] Oct 27 00:59:32.479502 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: Python main interpreter initialized at 0x558e3bf4b9c0 Oct 27 00:59:32.479502 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: python threads support enabled Oct 27 00:59:32.479502 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: your server socket listen backlog is limited to 100 connections Oct 27 00:59:32.479502 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: your mercy for graceful operations on workers is 90 seconds Oct 27 00:59:32.479823 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 00:59:32.479934 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: *** Operational MODE: preforking *** Oct 27 00:59:32.480296 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: *** uWSGI is running in multiple interpreter mode *** Oct 27 00:59:32.480296 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: spawned uWSGI master process (pid: 79878) Oct 27 00:59:32.480428 dv-cinder-815560-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Oct 27 00:59:32.482362 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: spawned uWSGI worker 1 (pid: 79889, cores: 1) Oct 27 00:59:32.482362 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: spawned uWSGI worker 2 (pid: 79890, cores: 1) Oct 27 00:59:32.482362 dv-cinder-815560-1-iscsi devstack@keystone.service[79878]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 00:59:37.608729 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 00:59:37.608729 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: from cryptography.utils import int_from_bytes Oct 27 00:59:37.609524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 00:59:37.609524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: from cryptography.utils import int_from_bytes Oct 27 00:59:37.609935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 00:59:37.609935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: from cryptography.utils import int_from_bytes Oct 27 00:59:37.610055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 00:59:37.610055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: from cryptography.utils import int_from_bytes Oct 27 00:59:37.658036 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 00:59:37.658234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 00:59:37.658322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 00:59:37.658408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] command line args: [] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 00:59:37.658485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 00:59:37.658603 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] command line args: [] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 00:59:37.658692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 00:59:37.658830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ================================================================================ {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 00:59:37.658916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 00:59:37.659036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ================================================================================ {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 00:59:37.659118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] admin_token = **** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.659288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] admin_token = **** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.659379 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] config_dir = [] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.659479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.659563 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] config_dir = [] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.659657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] config_source = [] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.659740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.659816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] debug = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.659979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] config_source = [] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.660057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.660292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] debug = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.660292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.660523 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.660621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.660716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.660816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] insecure_debug = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.660917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.661017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.661126 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.661223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.661323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] list_limit = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.661418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] list_limit = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.661523 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] log_config_append = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.661630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] log_config_append = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.661731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.661870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.662080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] log_dir = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.662271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] log_dir = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.662447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] log_file = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.662534 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] log_file = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.662652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.662730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.662852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.662926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663397 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.663998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.664072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.664196 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.664271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.664392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.664466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.664579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.664658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.664809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.664883 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665291 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] notification_format = cadf {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.32/identity {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665840 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] publish_errors = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] publish_errors = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.665992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.666174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.666265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.666405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.666487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.666563 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.666684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.666812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.666901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667124 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] standard_threads = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] standard_threads = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667367 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] strict_password_check = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667592 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] use_journal = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.667948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] use_eventlog = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] use_json = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668088 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] use_journal = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] use_stderr = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] use_json = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668352 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] use_syslog = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] use_stderr = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] use_syslog = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] watch_log_file = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 00:59:37.668881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.669044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.669128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.669281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.669363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.669524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.669611 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.669764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.669849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.669996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.670102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.670266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.670349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.670506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.670592 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.670739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.670853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.670981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.671085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.671226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.671342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.671440 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.671542 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.671682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.671774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.671915 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.672001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.672149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.672234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.672389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.672466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.672621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.672706 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.672854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.672941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.673100 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.673184 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.673333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.673418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.673566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.673644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.673819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.673900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.674087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.674179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.674330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.674411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.674549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.674627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.674776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.674859 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.675003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.675083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.675230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.675306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.675467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.675552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.675707 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.675786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.675932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.676017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.676157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.676241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.676384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.676462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.676627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.676705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.676862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.676939 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.677094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.677172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.677320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.677397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.677636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.677889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.677979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.678148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.678227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.678378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.678456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.678607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.678698 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.678835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.678915 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.679070 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.679149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.679318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.679396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.679547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.679632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.679780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.679863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.680007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.680086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.680240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.680320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.680479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.680558 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.680717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.680800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.680942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.681020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.681175 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.681254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.681408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.681486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.681641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.681726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.681872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.681951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.682132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.682214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.682359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.682438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.682597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.682675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.682827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.682912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.683063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.683141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.683292 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.683371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.683527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.683613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.683760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.683847 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.683986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.684063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.684219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.684298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.684450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.684535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.684687 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.684764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.684924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.685002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.685167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.685245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.685400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.685479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.685643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.685727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.685876 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.685957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.686132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.686212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.enabled = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.686367 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.686445 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.686600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.686679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.686831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.686915 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.687062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.687140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.687295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.687378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.687530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.687608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.687762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.687839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.687989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.688075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.688214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.688300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.688439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.688517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.688671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.688750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.688896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.688973 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.689127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.689211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.689357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.689442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.689595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.689673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.689823 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.689900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.690088 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.690183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.690328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.690406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.690585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.690671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.690811 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] auth.external = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.690888 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.691039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.691122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.691296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] auth.external = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.691382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.691527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] auth.mapped = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.691612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.691761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] auth.password = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.691838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.691988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] auth.token = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.692074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.692223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.692302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] auth.password = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.692454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.692537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] auth.token = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.692698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.692784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.692925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.693003 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] catalog.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.693695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.693774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.693926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.694094 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.694219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.694294 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.694401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] credential.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.694480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.694644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.694756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.694878 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] credential.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.694968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.695122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.695199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] credential.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.695354 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.695432 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.695593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.695679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.695824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.695902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.696063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.696142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.696299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.696386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.696530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.696612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.696777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.696856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.697011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.697098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.697265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.697344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.697529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.697607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.697768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.697897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.698045 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.698127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.698288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] federation.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.698366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.698524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.698616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.698766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] federation.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.698843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.699001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.699079 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.699230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.699315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] federation.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.699474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.699553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.699706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.699785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.699949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.700038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.700185 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.700263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.700435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.700514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.700669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.700756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.700910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.700989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.701142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.701220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.701385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.701471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.701620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.701700 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.701851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.701929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.702107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.702190 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.702348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.702425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.702572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.702660 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.702806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.702886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.703039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.703116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.703280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.703359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.703504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.703584 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.703731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.703816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.703957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.704043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.704200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.704290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.704428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.704506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.704676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.704755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.704925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.705005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.705171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.705249 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.705425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.705502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.705658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.705737 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.705891 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.705975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.706143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.706225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.706378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.706459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.706605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.706683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.706838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.706918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.707067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.707146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.707300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.707377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.707539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.707622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.707763 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.707842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.708005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.708084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.708235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.708318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.708469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.708548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.709315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.709464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.709578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.709689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.709820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.709949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.710103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.710231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.710363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.710498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.710680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.710758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.710828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.password = **** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.710898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.710969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.711039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.711119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.711191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.711357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.711437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.711593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.711671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.711830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.711910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.712079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.712158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.712304 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.712382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.712543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.712628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.712773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.712851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.713004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.713081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.713236 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.713317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.713467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.713545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.713694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.713780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.713925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.714002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.714180 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.714315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.714419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.714547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.714778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.714856 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.715012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.715089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.715259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.715344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.715494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.715573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.715723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.715800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.715956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.716042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.716184 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.716268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.716414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.716497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.716641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.716727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.716874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.716951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.717106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.717183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.717345 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.717430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.717587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.717665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.717829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.717909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.718095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.718193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.718321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.718396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.718553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.718632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.718785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.718872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.719018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.719103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.719251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.719329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.719488 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.719579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.719723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.719802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.719953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.720031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.720204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.720291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.720428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.720505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.720668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.720745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] policy.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.720898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.720984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.721130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.721214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.721361 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.721439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.721595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] receipt.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.721681 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.721830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.721908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.722090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.722170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.722327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.722417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.722557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.722634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] resource.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.722794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.722877 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.723035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.723120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] resource.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.723265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.723343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.723508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.723586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] resource.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.723741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.723826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.723972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.724048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.724213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.724350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.724487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.724627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] revoke.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.724750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.724831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.724924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] role.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.725055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.725164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] role.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.725254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] role.cache_time = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.725389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.725467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] role.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.725633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.725711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] role.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.725861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] role.list_limit = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.725947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.726131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.726215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.726377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.726455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.726620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.726707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.726862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.726940 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.727103 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.727181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.727347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.727425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.727571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.727647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.727812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.727896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.728044 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.728123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.728283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.728360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.728527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.728604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.728774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.728909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.729018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.729139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.729384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.729461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.729627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.729707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.729870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.729948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.730139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.730222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.730371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.730453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.730618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.730697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.730848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.730924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.731084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.731162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.731311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.731389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.731537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.731615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.731763 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.731843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.731999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.732077 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.732230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.732317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.732473 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.732551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.732707 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.732785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.732939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.733091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.733167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.733238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.733383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] token.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.733462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.733613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.733699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] token.cache_time = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.733844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] token.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.733922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.734096 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.734178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.734347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.734438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] token.provider = fernet {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.734583 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.734662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.734821 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.734899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.735061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.735148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.735295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.735373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.735537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.735614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.735770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.735856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.736003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.736089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] trust.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.736234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.736314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.736467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.736553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.736702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.736780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.736924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.737001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.737163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.737253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.737398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.737476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.737639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.737718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.connection = **** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.737887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.737976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.738152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.738233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.connection = **** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.738385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.738464 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.738634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.738724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.738865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.738941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.739097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.739175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.739329 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.739414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.739558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.739636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.739796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.739873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.740057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.740192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.740321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.740456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.740585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.740697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.740780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.740849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.740996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.741067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.741245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.741315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.741480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.741549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.741715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.741794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.741941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.742066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.742147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79889) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 00:59:37.742219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.742424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 00:59:37.742593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=79890) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 00:59:37.773593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.773780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.773867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.774011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.774114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.774260 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.782810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.782930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.811307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.811533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.811884 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.812112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.867083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:37.876742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.009346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.009574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.010892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.011131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.075383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.075566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.075732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.075817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.075882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.075982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.076072 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.076203 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.076295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.076411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.076497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.076629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.101435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.101684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.101775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.101939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.102053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.102227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.102327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.102449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.102532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.102668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.102751 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.102882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.102965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.103093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.113981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.114186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.127296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.127472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.127556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.127688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.127770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.127900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.127982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.128110 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.128191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.128317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.128398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.128525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79889) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.128609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.128736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=79890) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 27 00:59:38.146393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.146676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.146777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 00:59:38.146884 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 00:59:38.147095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.147216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.147298 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 00:59:38.147418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 27 00:59:38.147577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.147686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.147803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.147946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.148056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.148202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.148309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.148455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.159378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.159471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.159651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.159746 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.159914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.159997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.160188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.160270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.168816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.168910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.171999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.172085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.172275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.172370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.172550 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.172631 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.172825 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.172906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.173103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.173192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.173353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.173443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.173611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.173693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.173874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.173954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.174269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.174351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.174542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.174634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.174806 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.174886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.200939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.201359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.202509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.202785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.202951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.203225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.207983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.208258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.208468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.208551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.208769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.209042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.215746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.216022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.216146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.216422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.220338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.220618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.220893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.221169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.221550 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.221717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.221805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.222052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.222137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.222353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.222566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.222954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.223342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.223619 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.223892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.224162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.241936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.242236 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.245628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.245902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.246814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.250350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.250550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.250647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.254118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.254427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.255564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.259067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.259620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.262595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.262892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.263152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.263234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.263567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.263845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.264130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.266716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.267011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.267289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.267685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.267970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.268284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.282977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.283252 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.283513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.283772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.287630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.287908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.288171 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.288429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.292302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.293976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.294269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.296634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.297203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.297476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.297757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.298046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.298337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.298421 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.298593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.301551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.301832 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.302129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.303012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.303302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.311840 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.312115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.312385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.312660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.312932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.313214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.313490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.316400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.316683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.316955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.317230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.317506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.317775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.318116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.330913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.335487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.335615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.338742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.340130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.340299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.341882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.342179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.342457 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.343439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.345140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.346762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.347039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.347318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.350193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.351733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.354880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.355087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.355174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.355425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.355701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.356641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.359822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.360121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.360402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.360674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.364492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.364770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.365595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.370183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.370473 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.370751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.373338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79889) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.373615 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.373887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.374182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.374446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.374723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.374991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.375249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.375518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.375792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.376055 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.376317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.376572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.376846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79889) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.378594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=79890) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 27 00:59:38.378826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.379102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.379371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.379634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.379899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.380182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.380446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.380755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.381161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.381443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.381703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.381963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.382242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=79890) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 27 00:59:38.415503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e3bf4b9c0 pid: 79889 (default app) Oct 27 00:59:38.418725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42ce01-2e80-4188-a497-c95886b8b13d None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:38.419011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42ce01-2e80-4188-a497-c95886b8b13d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:38.419280 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42ce01-2e80-4188-a497-c95886b8b13d None None] PATH_INFO: `/v3` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:38.420201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558e3bf4b9c0 pid: 79890 (default app) Oct 27 00:59:38.423504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1/1] 10.222.0.32 () {50 vars in 791 bytes} [Wed Oct 27 00:59:38 2021] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:47.248672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6bfc-cd8a-449b-8f45-25e13f37fa98 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:47.249205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6bfc-cd8a-449b-8f45-25e13f37fa98 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:47.249205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764a6bfc-cd8a-449b-8f45-25e13f37fa98 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:47.254497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1/2] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:47 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:47.260593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:47.260957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:47.261132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:47.291628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG oslo_db.sqlalchemy.engines [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79889) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 00:59:47.475618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG passlib.handlers.bcrypt [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79889) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 00:59:47.476019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG passlib.handlers.bcrypt [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79889) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 00:59:47.531291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:47.532833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:47.663246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 2/3] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 404 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 00:59:47.812897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a6bfc-cd8a-449b-8f45-25e13f37fa98 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:47.846080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG oslo_db.sqlalchemy.engines [None req-764a6bfc-cd8a-449b-8f45-25e13f37fa98 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=79890) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 27 00:59:47.978929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764a6bfc-cd8a-449b-8f45-25e13f37fa98 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:47.983204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ea57e-313d-44e9-8616-0fa688b2d53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:47.983862 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea57e-313d-44e9-8616-0fa688b2d53d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:47.984140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea57e-313d-44e9-8616-0fa688b2d53d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:47.984413 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ea57e-313d-44e9-8616-0fa688b2d53d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:47.993167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ea57e-313d-44e9-8616-0fa688b2d53d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:48.043408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b92ea57e-313d-44e9-8616-0fa688b2d53d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 00:59:48.043745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ea57e-313d-44e9-8616-0fa688b2d53d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:48.053766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 2/4] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 00:59:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 00:59:48.061664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:48.075722 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd3c86b-6d44-42b0-8d11-e1719713b48b None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:48.079975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc9bf42-5c70-45f8-9a92-744a14f49af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:48.081060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9bf42-5c70-45f8-9a92-744a14f49af5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:48.081336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9bf42-5c70-45f8-9a92-744a14f49af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:48.081605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc9bf42-5c70-45f8-9a92-744a14f49af5 admin admin] PATH_INFO: `/v3/projects/3355962a746e4ae38c08a8001aa0f51d` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:48.083117 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9bf42-5c70-45f8-9a92-744a14f49af5 admin admin] RBAC: Authorizing `identity:get_project(project_id=3355962a746e4ae38c08a8001aa0f51d)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:48.135708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.common.rbac_enforcer.enforcer [None req-adc9bf42-5c70-45f8-9a92-744a14f49af5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 27 00:59:48.136043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc9bf42-5c70-45f8-9a92-744a14f49af5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:48.140580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 3/5] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 00:59:48 2021] GET /identity/v3/projects/3355962a746e4ae38c08a8001aa0f51d => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:50.363089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7024717-72f5-404f-b90e-fd909a350f8e None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:50.363694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7024717-72f5-404f-b90e-fd909a350f8e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:50.363694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7024717-72f5-404f-b90e-fd909a350f8e None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:50.368660 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 3/6] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:50 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:50.375028 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d6955-7142-4ec5-893c-777722aabb24 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:50.375463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d6955-7142-4ec5-893c-777722aabb24 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:50.375551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d6955-7142-4ec5-893c-777722aabb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:50.393698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-eb2d6955-7142-4ec5-893c-777722aabb24 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:50.395212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-eb2d6955-7142-4ec5-893c-777722aabb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:50.405588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 4/7] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 00:59:50.430176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7024717-72f5-404f-b90e-fd909a350f8e None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:50.442004 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7024717-72f5-404f-b90e-fd909a350f8e None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:50.446549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f384e69-19e9-4436-b708-d1ac6e00b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:50.447175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f384e69-19e9-4436-b708-d1ac6e00b386 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:50.447455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f384e69-19e9-4436-b708-d1ac6e00b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:50.447727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f384e69-19e9-4436-b708-d1ac6e00b386 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:50.455281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f384e69-19e9-4436-b708-d1ac6e00b386 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:50.457059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f384e69-19e9-4436-b708-d1ac6e00b386 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:50.465796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 4/8] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 00:59:50 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 00:59:50.471605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d6955-7142-4ec5-893c-777722aabb24 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:50.480959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d6955-7142-4ec5-893c-777722aabb24 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:50.485222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fda38-882a-4327-a995-2dc770196e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:50.486095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fda38-882a-4327-a995-2dc770196e29 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:50.486372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fda38-882a-4327-a995-2dc770196e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:50.486638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fda38-882a-4327-a995-2dc770196e29 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:50.488003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fda38-882a-4327-a995-2dc770196e29 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:50.490489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fda38-882a-4327-a995-2dc770196e29 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:50.492010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 5/9] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 00:59:50 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:52.758864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde06a91-35d3-4947-a480-dbe0cc81aa1a None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.759379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde06a91-35d3-4947-a480-dbe0cc81aa1a None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.759451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde06a91-35d3-4947-a480-dbe0cc81aa1a None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.761163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 5/10] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:52.767114 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccaf91-ea53-42e5-971d-3ab04e8441fe None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.767496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccaf91-ea53-42e5-971d-3ab04e8441fe None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.767727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcccaf91-ea53-42e5-971d-3ab04e8441fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.785586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-bcccaf91-ea53-42e5-971d-3ab04e8441fe None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:52.787336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bcccaf91-ea53-42e5-971d-3ab04e8441fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:52.794764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 6/11] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 00:59:52.817698 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c66d-3016-4f29-9c3e-459e42991072 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.818067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccaf91-ea53-42e5-971d-3ab04e8441fe None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:52.818275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c66d-3016-4f29-9c3e-459e42991072 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.818559 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a4c66d-3016-4f29-9c3e-459e42991072 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.820330 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 6/12] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:52.825953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2333c3-40ef-4953-be06-02b3879e1e50 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.826268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2333c3-40ef-4953-be06-02b3879e1e50 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.826542 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2333c3-40ef-4953-be06-02b3879e1e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.826974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcccaf91-ea53-42e5-971d-3ab04e8441fe None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:52.831314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4a418-a96a-4140-a462-d64a3d8d6bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:52.832061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4a418-a96a-4140-a462-d64a3d8d6bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.832337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4a418-a96a-4140-a462-d64a3d8d6bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.832606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc4a418-a96a-4140-a462-d64a3d8d6bc8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.845969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc4a418-a96a-4140-a462-d64a3d8d6bc8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 00:59:52.853447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-fbc4a418-a96a-4140-a462-d64a3d8d6bc8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 00:59:52.854650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 7/13] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 00:59:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 00:59:52.860977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4a418-a96a-4140-a462-d64a3d8d6bc8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:52.869018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG passlib.handlers.bcrypt [None req-3a2333c3-40ef-4953-be06-02b3879e1e50 None None] detected 'bcrypt' backend, version '3.2.0' {{(pid=79890) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 27 00:59:52.869438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG passlib.handlers.bcrypt [None req-3a2333c3-40ef-4953-be06-02b3879e1e50 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=79890) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 27 00:59:52.870415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc4a418-a96a-4140-a462-d64a3d8d6bc8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:52.874756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:52.875382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.875659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.875929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.876680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 00:59:52.876977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:52.878727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 00:59:52.878727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 00:59:52.878727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 00:59:52.879615 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:52.892174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 8/14] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 00:59:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 00:59:52.898670 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:52.907897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec4c121-e319-466c-bfd5-ffaa002e14bc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:52.912923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53bee8-2ad8-445d-ba81-33feefb3b903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:52.913727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53bee8-2ad8-445d-ba81-33feefb3b903 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.914006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53bee8-2ad8-445d-ba81-33feefb3b903 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.914315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53bee8-2ad8-445d-ba81-33feefb3b903 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.915495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53bee8-2ad8-445d-ba81-33feefb3b903 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:52.916271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-3a2333c3-40ef-4953-be06-02b3879e1e50 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:52.917260 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53bee8-2ad8-445d-ba81-33feefb3b903 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:52.917856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-3a2333c3-40ef-4953-be06-02b3879e1e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:52.918851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 9/15] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 00:59:52 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 00:59:52.924232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53bee8-2ad8-445d-ba81-33feefb3b903 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:52.933394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53bee8-2ad8-445d-ba81-33feefb3b903 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:52.937680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6714704-b736-4c8a-a362-ba3b5227a93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:52.938364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6714704-b736-4c8a-a362-ba3b5227a93f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.938647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6714704-b736-4c8a-a362-ba3b5227a93f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.938911 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6714704-b736-4c8a-a362-ba3b5227a93f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.940079 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6714704-b736-4c8a-a362-ba3b5227a93f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:52.941721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6714704-b736-4c8a-a362-ba3b5227a93f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:52.943288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 10/16] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 00:59:52 2021] GET /identity/v3/domains/default => generated 199 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 00:59:52.943803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 7/17] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 00:59:52.949090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6714704-b736-4c8a-a362-ba3b5227a93f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:52.958665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6714704-b736-4c8a-a362-ba3b5227a93f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:52.963005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:52.963597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.963877 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.964152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.964972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.domain.id=default, user.id=5c3a6c2e10d54dfc8b895992ac771847) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 00:59:52.965278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:52.966281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 00:59:52.966281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 00:59:52.966281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 00:59:52.966602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2333c3-40ef-4953-be06-02b3879e1e50 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:52.967412 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:52.975036 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 11/18] 10.222.0.32 () {56 vars in 1343 bytes} [Wed Oct 27 00:59:52 2021] GET /identity/v3/role_assignments?user.id=5c3a6c2e10d54dfc8b895992ac771847&scope.domain.id=default&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 233 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:52.976349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2333c3-40ef-4953-be06-02b3879e1e50 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:52.980762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cd0e52-2909-4c97-a1a4-ec9c0b20dedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:52.981775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd0e52-2909-4c97-a1a4-ec9c0b20dedc admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:52.982119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd0e52-2909-4c97-a1a4-ec9c0b20dedc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:52.982364 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cd0e52-2909-4c97-a1a4-ec9c0b20dedc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:52.991393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd0e52-2909-4c97-a1a4-ec9c0b20dedc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:52.993258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cd0e52-2909-4c97-a1a4-ec9c0b20dedc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:53.003373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 8/19] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 00:59:52 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 00:59:53.010551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:53.021160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee5d58-e0e7-43b2-b67b-8987defe4683 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:53.026463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5a3aa0-b606-4271-befb-0f3268bedb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:53.027332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a3aa0-b606-4271-befb-0f3268bedb3e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:53.027648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a3aa0-b606-4271-befb-0f3268bedb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:53.027925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5a3aa0-b606-4271-befb-0f3268bedb3e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:53.029331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a3aa0-b606-4271-befb-0f3268bedb3e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:53.031143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5a3aa0-b606-4271-befb-0f3268bedb3e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:53.032868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 12/20] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 00:59:53 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:55.442843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ea56-43fc-41a5-b22d-bc8b95b325b8 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:55.443543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ea56-43fc-41a5-b22d-bc8b95b325b8 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:55.443543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8ea56-43fc-41a5-b22d-bc8b95b325b8 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:55.445499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 9/21] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:55.451499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba8ce6-aed5-4707-8f84-bff50cea7ad8 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:55.452284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba8ce6-aed5-4707-8f84-bff50cea7ad8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:55.452764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba8ce6-aed5-4707-8f84-bff50cea7ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:55.478158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-a5ba8ce6-aed5-4707-8f84-bff50cea7ad8 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:55.479346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a5ba8ce6-aed5-4707-8f84-bff50cea7ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:55.487200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 13/22] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:55 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 00:59:55.513270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ea56-43fc-41a5-b22d-bc8b95b325b8 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:55.527875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8ea56-43fc-41a5-b22d-bc8b95b325b8 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:55.532849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668362e-1c21-43a1-a0f3-ff6f228c9855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:55.533992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668362e-1c21-43a1-a0f3-ff6f228c9855 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:55.541401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668362e-1c21-43a1-a0f3-ff6f228c9855 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:55.541401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668362e-1c21-43a1-a0f3-ff6f228c9855 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:55.551847 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668362e-1c21-43a1-a0f3-ff6f228c9855 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 00:59:55.559530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-4668362e-1c21-43a1-a0f3-ff6f228c9855 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 00:59:55.561359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 10/23] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 00:59:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 00:59:55.568584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba8ce6-aed5-4707-8f84-bff50cea7ad8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:55.583476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba8ce6-aed5-4707-8f84-bff50cea7ad8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:55.594194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc9151-3f71-4694-8162-c99ee671f82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:55.594865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc9151-3f71-4694-8162-c99ee671f82f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:55.595142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc9151-3f71-4694-8162-c99ee671f82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:55.595411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cc9151-3f71-4694-8162-c99ee671f82f admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:55.596180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc9151-3f71-4694-8162-c99ee671f82f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 00:59:55.596479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc9151-3f71-4694-8162-c99ee671f82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:55.598106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cc9151-3f71-4694-8162-c99ee671f82f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:55.609770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 14/24] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 00:59:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:55.616600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668362e-1c21-43a1-a0f3-ff6f228c9855 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:55.630660 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668362e-1c21-43a1-a0f3-ff6f228c9855 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:55.635971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6738a7-cd59-49b4-82e1-77f3bfb48d64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:55.637078 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6738a7-cd59-49b4-82e1-77f3bfb48d64 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:55.637570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6738a7-cd59-49b4-82e1-77f3bfb48d64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:55.638101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6738a7-cd59-49b4-82e1-77f3bfb48d64 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:55.640020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6738a7-cd59-49b4-82e1-77f3bfb48d64 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:55.642137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6738a7-cd59-49b4-82e1-77f3bfb48d64 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:55.644446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 11/25] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 00:59:55 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:55.651888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc9151-3f71-4694-8162-c99ee671f82f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:55.667071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cc9151-3f71-4694-8162-c99ee671f82f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:55.674101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509e9385-6e25-4a49-9b63-70d1db88897e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:55.674896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9385-6e25-4a49-9b63-70d1db88897e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:55.675172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9385-6e25-4a49-9b63-70d1db88897e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:55.675439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509e9385-6e25-4a49-9b63-70d1db88897e admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:55.683060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e9385-6e25-4a49-9b63-70d1db88897e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:55.684901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509e9385-6e25-4a49-9b63-70d1db88897e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:55.687040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 15/26] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 00:59:55 2021] GET /identity/v3/domains/default => generated 199 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:55.694169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6738a7-cd59-49b4-82e1-77f3bfb48d64 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:55.707112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6738a7-cd59-49b4-82e1-77f3bfb48d64 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:55.720465 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18fd36a-0caf-4634-a0da-a5b627735fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:55.722126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fd36a-0caf-4634-a0da-a5b627735fe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:55.722666 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fd36a-0caf-4634-a0da-a5b627735fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:55.723151 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18fd36a-0caf-4634-a0da-a5b627735fe1 admin admin] PATH_INFO: `/v3/domains/default/users/5c3a6c2e10d54dfc8b895992ac771847/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:55.726551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fd36a-0caf-4634-a0da-a5b627735fe1 admin admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5c3a6c2e10d54dfc8b895992ac771847, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:55.728568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-a18fd36a-0caf-4634-a0da-a5b627735fe1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 00:59:55.728568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 00:59:55.728568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 00:59:55.731024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18fd36a-0caf-4634-a0da-a5b627735fe1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:55.992838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 12/27] 10.222.0.32 () {58 vars in 1382 bytes} [Wed Oct 27 00:59:55 2021] PUT /identity/v3/domains/default/users/5c3a6c2e10d54dfc8b895992ac771847/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 00:59:56.000891 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e67e84-a5e4-4e8f-8cc3-20c649510279 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.000891 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e67e84-a5e4-4e8f-8cc3-20c649510279 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.001061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e67e84-a5e4-4e8f-8cc3-20c649510279 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.003405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 16/28] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:56.011670 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5f71e-3fa3-4bc4-8eda-b911f10e6e7a None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.012352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5f71e-3fa3-4bc4-8eda-b911f10e6e7a None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.012866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be5f71e-3fa3-4bc4-8eda-b911f10e6e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.035750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1be5f71e-3fa3-4bc4-8eda-b911f10e6e7a None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:56.038185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1be5f71e-3fa3-4bc4-8eda-b911f10e6e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:56.133595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 13/29] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 00:59:56.166701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e67e84-a5e4-4e8f-8cc3-20c649510279 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:56.186084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e67e84-a5e4-4e8f-8cc3-20c649510279 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:56.196991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec91bc-69b7-4eef-a93e-02c1db274768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:56.197675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec91bc-69b7-4eef-a93e-02c1db274768 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.197951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec91bc-69b7-4eef-a93e-02c1db274768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.198251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dec91bc-69b7-4eef-a93e-02c1db274768 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.199028 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec91bc-69b7-4eef-a93e-02c1db274768 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:56.200039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-1dec91bc-69b7-4eef-a93e-02c1db274768 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 00:59:56.200039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 00:59:56.200039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 00:59:56.200939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dec91bc-69b7-4eef-a93e-02c1db274768 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:56.333777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2a56-b470-4ac7-81ca-af9d00c0dfaf None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.334622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2a56-b470-4ac7-81ca-af9d00c0dfaf None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.335315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f2a56-b470-4ac7-81ca-af9d00c0dfaf None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.340470 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 14/30] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:56 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 00:59:56.348599 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3957d7f-6d1d-4beb-8e4c-0929eb3c9d1d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.349475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3957d7f-6d1d-4beb-8e4c-0929eb3c9d1d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.349997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3957d7f-6d1d-4beb-8e4c-0929eb3c9d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.370377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c3957d7f-6d1d-4beb-8e4c-0929eb3c9d1d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:56.371911 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c3957d7f-6d1d-4beb-8e4c-0929eb3c9d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:56.381730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 15/31] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 00:59:56.425005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3957d7f-6d1d-4beb-8e4c-0929eb3c9d1d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:56.436790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 17/32] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 00:59:56 2021] POST /identity/v3/roles => generated 219 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 00:59:56.439922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3957d7f-6d1d-4beb-8e4c-0929eb3c9d1d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:56.451796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206c4bc-111a-476f-b18b-c5745fcafb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:56.453497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206c4bc-111a-476f-b18b-c5745fcafb0b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.453952 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206c4bc-111a-476f-b18b-c5745fcafb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.454419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9206c4bc-111a-476f-b18b-c5745fcafb0b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.477510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206c4bc-111a-476f-b18b-c5745fcafb0b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:56.480315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9206c4bc-111a-476f-b18b-c5745fcafb0b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:56.511396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-9206c4bc-111a-476f-b18b-c5745fcafb0b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 00:59:56.513087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 16/33] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 00:59:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 00:59:56.519899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec91bc-69b7-4eef-a93e-02c1db274768 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:56.539555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dec91bc-69b7-4eef-a93e-02c1db274768 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:56.550167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6946a-76d4-48ee-a77a-8277d71919f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:56.550851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6946a-76d4-48ee-a77a-8277d71919f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.551132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6946a-76d4-48ee-a77a-8277d71919f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.551408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6946a-76d4-48ee-a77a-8277d71919f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.552715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6946a-76d4-48ee-a77a-8277d71919f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 00:59:56.553018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6946a-76d4-48ee-a77a-8277d71919f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:56.554350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-95b6946a-76d4-48ee-a77a-8277d71919f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 00:59:56.554350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 00:59:56.554350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 00:59:56.555261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6946a-76d4-48ee-a77a-8277d71919f4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:56.586011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 18/34] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 00:59:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:56.592296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206c4bc-111a-476f-b18b-c5745fcafb0b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:56.607572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9206c4bc-111a-476f-b18b-c5745fcafb0b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:56.617065 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f64866-70d0-4e2d-a60f-43cc11de1d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:56.618209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f64866-70d0-4e2d-a60f-43cc11de1d31 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.618728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f64866-70d0-4e2d-a60f-43cc11de1d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.619216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f64866-70d0-4e2d-a60f-43cc11de1d31 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.620188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f64866-70d0-4e2d-a60f-43cc11de1d31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:56.621568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-59f64866-70d0-4e2d-a60f-43cc11de1d31 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 00:59:56.621568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 00:59:56.621568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 00:59:56.627451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f64866-70d0-4e2d-a60f-43cc11de1d31 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:56.737919 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dca935-1ff2-4fe3-8309-5c899f80a26d None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.738256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dca935-1ff2-4fe3-8309-5c899f80a26d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.738502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dca935-1ff2-4fe3-8309-5c899f80a26d None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.741197 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 19/35] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:56.747149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31a263-4076-4dfa-9443-23f163ece8f9 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.747436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31a263-4076-4dfa-9443-23f163ece8f9 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.747709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c31a263-4076-4dfa-9443-23f163ece8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.771434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-1c31a263-4076-4dfa-9443-23f163ece8f9 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:56.773455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1c31a263-4076-4dfa-9443-23f163ece8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:56.785481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 17/36] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 00:59:56 2021] POST /identity/v3/projects => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 00:59:56.793516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 20/37] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:56 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 00:59:56.845740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f64866-70d0-4e2d-a60f-43cc11de1d31 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:56.929685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f64866-70d0-4e2d-a60f-43cc11de1d31 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:56.934875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af67841-faea-4314-a9aa-ec26bedb8184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:56.935894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af67841-faea-4314-a9aa-ec26bedb8184 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:56.936414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af67841-faea-4314-a9aa-ec26bedb8184 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:56.936903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af67841-faea-4314-a9aa-ec26bedb8184 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:56.937955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af67841-faea-4314-a9aa-ec26bedb8184 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:56.939412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-2af67841-faea-4314-a9aa-ec26bedb8184 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 00:59:56.939412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 00:59:56.939412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 00:59:56.940753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af67841-faea-4314-a9aa-ec26bedb8184 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:57.019694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 18/38] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 00:59:56 2021] POST /identity/v3/roles => generated 225 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 00:59:57.212242 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c20564-8632-4182-ad3d-b4ece49ffb78 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:57.212736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c20564-8632-4182-ad3d-b4ece49ffb78 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:57.212849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c20564-8632-4182-ad3d-b4ece49ffb78 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:57.215047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 21/39] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:57.221700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207bd7b-11d2-4395-95b2-63e805a727df None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:57.222356 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207bd7b-11d2-4395-95b2-63e805a727df None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:57.222865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3207bd7b-11d2-4395-95b2-63e805a727df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:57.247696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-3207bd7b-11d2-4395-95b2-63e805a727df None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:57.249290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-3207bd7b-11d2-4395-95b2-63e805a727df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:57.260464 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 19/40] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 00:59:57.287355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c20564-8632-4182-ad3d-b4ece49ffb78 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:57.304248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c20564-8632-4182-ad3d-b4ece49ffb78 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:57.310472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a44221a-579b-46cb-9e11-d1e082b649fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:57.311336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44221a-579b-46cb-9e11-d1e082b649fc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:57.311633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44221a-579b-46cb-9e11-d1e082b649fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:57.311914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a44221a-579b-46cb-9e11-d1e082b649fc admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:57.313397 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44221a-579b-46cb-9e11-d1e082b649fc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:57.316369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a44221a-579b-46cb-9e11-d1e082b649fc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:57.319527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 22/41] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 00:59:57 2021] GET /identity/v3/domains/default => generated 199 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 00:59:57.325932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207bd7b-11d2-4395-95b2-63e805a727df None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:57.336137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3207bd7b-11d2-4395-95b2-63e805a727df None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:57.341188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998ed16-236e-4981-beb5-c26e126e6d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:57.342094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998ed16-236e-4981-beb5-c26e126e6d91 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:57.342522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998ed16-236e-4981-beb5-c26e126e6d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:57.342941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998ed16-236e-4981-beb5-c26e126e6d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:57.343898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998ed16-236e-4981-beb5-c26e126e6d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:57.346000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998ed16-236e-4981-beb5-c26e126e6d91 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:57.446575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fefc-c695-4790-9692-f62501110ad4 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:57.446861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fefc-c695-4790-9692-f62501110ad4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:57.447133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141fefc-c695-4790-9692-f62501110ad4 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:57.448897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 23/42] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 00:59:57.454463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634d1a1-6114-4314-a137-bb2351bc53fe None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:57.454746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634d1a1-6114-4314-a137-bb2351bc53fe None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:57.455023 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634d1a1-6114-4314-a137-bb2351bc53fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:57.459802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 20/43] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 00:59:57 2021] POST /identity/v3/projects => generated 312 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 00:59:57.474076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b634d1a1-6114-4314-a137-bb2351bc53fe None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:57.475212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b634d1a1-6114-4314-a137-bb2351bc53fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:57.537666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 24/44] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:57 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 00:59:57.561920 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998ed16-236e-4981-beb5-c26e126e6d91 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:57.573016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998ed16-236e-4981-beb5-c26e126e6d91 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:57.577896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f6672-1f4b-4495-8350-42284cf22e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:57.578627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f6672-1f4b-4495-8350-42284cf22e60 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:57.579011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f6672-1f4b-4495-8350-42284cf22e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:57.579288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f6672-1f4b-4495-8350-42284cf22e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:57.580138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f6672-1f4b-4495-8350-42284cf22e60 admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:57.581865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f6672-1f4b-4495-8350-42284cf22e60 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:57.699347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 21/45] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 00:59:57 2021] POST /identity/v3/roles => generated 223 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 00:59:58.775622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b1c86-4ab9-43f9-a93b-c956eb50a40b None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:58.776134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b1c86-4ab9-43f9-a93b-c956eb50a40b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:58.776204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b1c86-4ab9-43f9-a93b-c956eb50a40b None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:58.777992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 25/46] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:58.784020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b01e5d-c751-4b77-a08b-c2a5cd7deca7 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:58.784431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b01e5d-c751-4b77-a08b-c2a5cd7deca7 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:58.784577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b01e5d-c751-4b77-a08b-c2a5cd7deca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:58.802420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-19b01e5d-c751-4b77-a08b-c2a5cd7deca7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:58.803598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-19b01e5d-c751-4b77-a08b-c2a5cd7deca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:58.810964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 22/47] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:58 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 00:59:58.835330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b1c86-4ab9-43f9-a93b-c956eb50a40b None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:58.847253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b1c86-4ab9-43f9-a93b-c956eb50a40b None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:58.852382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801de93-c4fc-4707-99fc-61e89946cc4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:58.853151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801de93-c4fc-4707-99fc-61e89946cc4f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:58.853428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801de93-c4fc-4707-99fc-61e89946cc4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:58.853698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801de93-c4fc-4707-99fc-61e89946cc4f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:58.863561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801de93-c4fc-4707-99fc-61e89946cc4f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 00:59:58.870505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-4801de93-c4fc-4707-99fc-61e89946cc4f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 00:59:58.871658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 26/48] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 00:59:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 00:59:58.877865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b01e5d-c751-4b77-a08b-c2a5cd7deca7 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:58.886575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b01e5d-c751-4b77-a08b-c2a5cd7deca7 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:58.890854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:58.891498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:58.891776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:58.892047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:58.892796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 00:59:58.893097 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:58.894125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_roles failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 00:59:58.894125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 00:59:58.894125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 00:59:58.895013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:58.908091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 23/49] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 00:59:58 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:58.914361 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801de93-c4fc-4707-99fc-61e89946cc4f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:58.924151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801de93-c4fc-4707-99fc-61e89946cc4f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:58.928592 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c6eff-6990-4ba2-a40b-d5bb05cf4fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:58.929418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c6eff-6990-4ba2-a40b-d5bb05cf4fdf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:58.929976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c6eff-6990-4ba2-a40b-d5bb05cf4fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:58.930298 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c6eff-6990-4ba2-a40b-d5bb05cf4fdf admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:58.931483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c6eff-6990-4ba2-a40b-d5bb05cf4fdf admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:58.933283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9c6eff-6990-4ba2-a40b-d5bb05cf4fdf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:58.934937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 27/50] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 00:59:58 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:58.940462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:58.949650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88e279-92df-4dc4-a69e-7f5b2706d4c7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:58.953889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9e68c-6ec1-4144-a6f0-77b9638b239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:58.954675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9e68c-6ec1-4144-a6f0-77b9638b239d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:58.954956 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9e68c-6ec1-4144-a6f0-77b9638b239d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:58.955229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9e68c-6ec1-4144-a6f0-77b9638b239d admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:58.956390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9e68c-6ec1-4144-a6f0-77b9638b239d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:58.958626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9e68c-6ec1-4144-a6f0-77b9638b239d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:58.960186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 24/51] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 00:59:58 2021] GET /identity/v3/domains/default => generated 199 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 00:59:58.966169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c6eff-6990-4ba2-a40b-d5bb05cf4fdf admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:58.976132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c6eff-6990-4ba2-a40b-d5bb05cf4fdf admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:58.980391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260c800-1582-4204-8bbe-c5ab1ea2bcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:58.981007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260c800-1582-4204-8bbe-c5ab1ea2bcc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:58.981284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260c800-1582-4204-8bbe-c5ab1ea2bcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:58.981555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260c800-1582-4204-8bbe-c5ab1ea2bcc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:58.982428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260c800-1582-4204-8bbe-c5ab1ea2bcc8 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.domain.id=default, user.id=5c3a6c2e10d54dfc8b895992ac771847) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 00:59:58.982738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260c800-1582-4204-8bbe-c5ab1ea2bcc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:58.984570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260c800-1582-4204-8bbe-c5ab1ea2bcc8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:58.990543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 28/52] 10.222.0.32 () {56 vars in 1343 bytes} [Wed Oct 27 00:59:58 2021] GET /identity/v3/role_assignments?user.id=5c3a6c2e10d54dfc8b895992ac771847&scope.domain.id=default&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 530 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:59.741557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba18f2-d664-4abd-9904-c368987a0347 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:59.741848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba18f2-d664-4abd-9904-c368987a0347 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:59.742152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffba18f2-d664-4abd-9904-c368987a0347 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:59.743929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 25/53] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 00:59:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 00:59:59.749793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686463-ab00-45fd-b158-90423de621e7 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:59.750115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686463-ab00-45fd-b158-90423de621e7 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:59.750393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686463-ab00-45fd-b158-90423de621e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:59.767381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-01686463-ab00-45fd-b158-90423de621e7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 00:59:59.768563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-01686463-ab00-45fd-b158-90423de621e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 00:59:59.776994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 29/54] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 00:59:59 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 00:59:59.801180 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba18f2-d664-4abd-9904-c368987a0347 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:59.812908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffba18f2-d664-4abd-9904-c368987a0347 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:59.817056 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9734b-0b8a-4662-99dc-96d100eeb788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:59.817809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9734b-0b8a-4662-99dc-96d100eeb788 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:59.818119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9734b-0b8a-4662-99dc-96d100eeb788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:59.818394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9734b-0b8a-4662-99dc-96d100eeb788 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:59.819550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9734b-0b8a-4662-99dc-96d100eeb788 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:59.821206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa9734b-0b8a-4662-99dc-96d100eeb788 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:59.822782 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 26/55] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 00:59:59 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 00:59:59.828584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686463-ab00-45fd-b158-90423de621e7 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 00:59:59.838136 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686463-ab00-45fd-b158-90423de621e7 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 00:59:59.842443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197242f8-7141-4e0c-9126-b4ad2bc03010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 00:59:59.843080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197242f8-7141-4e0c-9126-b4ad2bc03010 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 00:59:59.843363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197242f8-7141-4e0c-9126-b4ad2bc03010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 00:59:59.843640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197242f8-7141-4e0c-9126-b4ad2bc03010 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 00:59:59.844362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197242f8-7141-4e0c-9126-b4ad2bc03010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 00:59:59.845368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-197242f8-7141-4e0c-9126-b4ad2bc03010 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 00:59:59.845368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 00:59:59.845368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 00:59:59.846606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197242f8-7141-4e0c-9126-b4ad2bc03010 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 00:59:59.944713 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 30/56] 10.222.0.32 () {60 vars in 1161 bytes} [Wed Oct 27 00:59:59 2021] POST /identity/v3/projects => generated 298 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:00:02.181744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5ebc0-b22a-4314-9d5b-df207fa1d814 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:02.182350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5ebc0-b22a-4314-9d5b-df207fa1d814 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:02.182350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5ebc0-b22a-4314-9d5b-df207fa1d814 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:02.184108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 27/57] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:02 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:02.189970 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd291c-ed74-4aa4-9752-b790ed8ca650 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:02.190427 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd291c-ed74-4aa4-9752-b790ed8ca650 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:02.190601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddd291c-ed74-4aa4-9752-b790ed8ca650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:02.207869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-dddd291c-ed74-4aa4-9752-b790ed8ca650 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:02.209052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-dddd291c-ed74-4aa4-9752-b790ed8ca650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:02.263414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 31/58] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:02 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:02.289514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5ebc0-b22a-4314-9d5b-df207fa1d814 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:02.301813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5ebc0-b22a-4314-9d5b-df207fa1d814 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:02.306043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa943d1-b24b-4f8f-bebb-702bf207aaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:02.306830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa943d1-b24b-4f8f-bebb-702bf207aaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:02.307114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa943d1-b24b-4f8f-bebb-702bf207aaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:02.307387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa943d1-b24b-4f8f-bebb-702bf207aaf0 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:02.308560 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa943d1-b24b-4f8f-bebb-702bf207aaf0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:02.310277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa943d1-b24b-4f8f-bebb-702bf207aaf0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:02.311825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 28/59] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:02 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:02.317522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd291c-ed74-4aa4-9752-b790ed8ca650 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:02.326186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddd291c-ed74-4aa4-9752-b790ed8ca650 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:02.330409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99f0277-f280-49f8-adf9-03be84d9eef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:02.331055 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f0277-f280-49f8-adf9-03be84d9eef3 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:02.331333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f0277-f280-49f8-adf9-03be84d9eef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:02.331606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99f0277-f280-49f8-adf9-03be84d9eef3 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:02.332316 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f0277-f280-49f8-adf9-03be84d9eef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:02.333460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-b99f0277-f280-49f8-adf9-03be84d9eef3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:02.333460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:00:02.333460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:00:02.334702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99f0277-f280-49f8-adf9-03be84d9eef3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:02.434848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 32/60] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:00:02 2021] POST /identity/v3/users => generated 275 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:00:05.937837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ce1f-7a93-49aa-8c0f-67ad6fcf42ed None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:05.938789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ce1f-7a93-49aa-8c0f-67ad6fcf42ed None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:05.939253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20ce1f-7a93-49aa-8c0f-67ad6fcf42ed None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:05.941488 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 29/61] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:05 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:05.945300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe7451-39f7-485c-af80-9b62205b2ed0 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:05.945727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe7451-39f7-485c-af80-9b62205b2ed0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:05.945843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe7451-39f7-485c-af80-9b62205b2ed0 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:05.948090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 33/62] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:05.952338 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4b98b-dd74-48d6-8137-65287e71006f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:05.952811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4b98b-dd74-48d6-8137-65287e71006f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:05.953084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4b98b-dd74-48d6-8137-65287e71006f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:05.953572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3144-6919-4a15-84bc-ff0c350d900d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:05.954107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3144-6919-4a15-84bc-ff0c350d900d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:05.954589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0c3144-6919-4a15-84bc-ff0c350d900d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:05.975301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-7a0c3144-6919-4a15-84bc-ff0c350d900d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:05.976846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7a0c3144-6919-4a15-84bc-ff0c350d900d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:05.983441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-48f4b98b-dd74-48d6-8137-65287e71006f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:05.984606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-48f4b98b-dd74-48d6-8137-65287e71006f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:05.989361 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 34/63] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:06.001486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 30/64] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:05 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:06.018853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3144-6919-4a15-84bc-ff0c350d900d None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.031020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0c3144-6919-4a15-84bc-ff0c350d900d None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.037572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4b98b-dd74-48d6-8137-65287e71006f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.040227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab8e0b-a27b-4bb3-81a5-e36a33f197dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.041043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab8e0b-a27b-4bb3-81a5-e36a33f197dd admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.041468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab8e0b-a27b-4bb3-81a5-e36a33f197dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.041746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab8e0b-a27b-4bb3-81a5-e36a33f197dd admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.050061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4b98b-dd74-48d6-8137-65287e71006f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.054445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab8e0b-a27b-4bb3-81a5-e36a33f197dd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:06.062168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-acab8e0b-a27b-4bb3-81a5-e36a33f197dd admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:06.063767 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 35/65] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:06.065514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eee36a-80a1-4f33-8da9-89820bc3384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.066489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee36a-80a1-4f33-8da9-89820bc3384f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.067431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee36a-80a1-4f33-8da9-89820bc3384f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.067844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eee36a-80a1-4f33-8da9-89820bc3384f admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.071017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab8e0b-a27b-4bb3-81a5-e36a33f197dd admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.085677 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab8e0b-a27b-4bb3-81a5-e36a33f197dd admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.086853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1335b-89df-4bad-b202-c1911d2d55d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.087178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eee36a-80a1-4f33-8da9-89820bc3384f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:06.087483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1335b-89df-4bad-b202-c1911d2d55d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.087832 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1335b-89df-4bad-b202-c1911d2d55d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.088170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab1335b-89df-4bad-b202-c1911d2d55d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.089002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1335b-89df-4bad-b202-c1911d2d55d8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:06.089373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1335b-89df-4bad-b202-c1911d2d55d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.091075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab1335b-89df-4bad-b202-c1911d2d55d8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.096125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-36eee36a-80a1-4f33-8da9-89820bc3384f admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:06.097624 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 31/66] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:06.100048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332fbe4-e942-4a1e-82df-dab3111e89b6 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.100786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332fbe4-e942-4a1e-82df-dab3111e89b6 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.101223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332fbe4-e942-4a1e-82df-dab3111e89b6 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.103368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 32/67] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:06.108143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 36/68] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.109613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994777a-63f4-439e-9118-608d2a52fddc None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.110136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994777a-63f4-439e-9118-608d2a52fddc None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.110617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d994777a-63f4-439e-9118-608d2a52fddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.111459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1335b-89df-4bad-b202-c1911d2d55d8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.122659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab1335b-89df-4bad-b202-c1911d2d55d8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.127113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b21d-613a-45c9-b71b-d6857210b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.127985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b21d-613a-45c9-b71b-d6857210b8bf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.128264 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b21d-613a-45c9-b71b-d6857210b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.128539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4682b21d-613a-45c9-b71b-d6857210b8bf admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.132153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d994777a-63f4-439e-9118-608d2a52fddc None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:06.133405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d994777a-63f4-439e-9118-608d2a52fddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:06.141609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 33/69] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:06.146068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994777a-63f4-439e-9118-608d2a52fddc None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.146192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682b21d-613a-45c9-b71b-d6857210b8bf admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.146750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4682b21d-613a-45c9-b71b-d6857210b8bf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.148520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 37/70] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:06.154745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b21d-613a-45c9-b71b-d6857210b8bf admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.164427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d994777a-63f4-439e-9118-608d2a52fddc None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.165586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4682b21d-613a-45c9-b71b-d6857210b8bf admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.170474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1449f-8f09-4b0f-9424-6b874e4f3a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.171333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1449f-8f09-4b0f-9424-6b874e4f3a10 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.171791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1449f-8f09-4b0f-9424-6b874e4f3a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.172384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1449f-8f09-4b0f-9424-6b874e4f3a10 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.178693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effbb9d-77d6-4592-ae8a-6cc97637e4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.179409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effbb9d-77d6-4592-ae8a-6cc97637e4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.179692 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effbb9d-77d6-4592-ae8a-6cc97637e4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.179964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effbb9d-77d6-4592-ae8a-6cc97637e4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.180747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effbb9d-77d6-4592-ae8a-6cc97637e4e5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:06.181056 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effbb9d-77d6-4592-ae8a-6cc97637e4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.182454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1449f-8f09-4b0f-9424-6b874e4f3a10 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.182724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7effbb9d-77d6-4592-ae8a-6cc97637e4e5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.184603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1449f-8f09-4b0f-9424-6b874e4f3a10 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.192395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 34/71] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.197054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effbb9d-77d6-4592-ae8a-6cc97637e4e5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.201302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 38/72] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:00:06.202226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1449f-8f09-4b0f-9424-6b874e4f3a10 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.209370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effbb9d-77d6-4592-ae8a-6cc97637e4e5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.211918 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1449f-8f09-4b0f-9424-6b874e4f3a10 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.214439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2443d8-d147-4185-bfe4-0ce2e92277c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.215399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2443d8-d147-4185-bfe4-0ce2e92277c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.215908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2443d8-d147-4185-bfe4-0ce2e92277c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.216475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2443d8-d147-4185-bfe4-0ce2e92277c4 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.216699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d661bc-2a04-466d-a71a-9dca20a615cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.217689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d661bc-2a04-466d-a71a-9dca20a615cc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.218146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d661bc-2a04-466d-a71a-9dca20a615cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.218577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d661bc-2a04-466d-a71a-9dca20a615cc admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.219963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d661bc-2a04-466d-a71a-9dca20a615cc admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.221914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d661bc-2a04-466d-a71a-9dca20a615cc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.224065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 39/73] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.226099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d661bc-2a04-466d-a71a-9dca20a615cc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.228407 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2443d8-d147-4185-bfe4-0ce2e92277c4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:06.235885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-df2443d8-d147-4185-bfe4-0ce2e92277c4 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:06.237160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 35/74] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:06.237933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2443d8-d147-4185-bfe4-0ce2e92277c4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.239358 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d661bc-2a04-466d-a71a-9dca20a615cc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.246516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351ab9a-6b1b-4dd9-9715-975599089546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.247529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351ab9a-6b1b-4dd9-9715-975599089546 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.247967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351ab9a-6b1b-4dd9-9715-975599089546 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.248387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6351ab9a-6b1b-4dd9-9715-975599089546 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.249726 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351ab9a-6b1b-4dd9-9715-975599089546 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.251973 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6351ab9a-6b1b-4dd9-9715-975599089546 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.254599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 40/75] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.254860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2443d8-d147-4185-bfe4-0ce2e92277c4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.255743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351ab9a-6b1b-4dd9-9715-975599089546 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.259967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde61b9f-50a7-4f53-a465-1d6db43be137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.260616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde61b9f-50a7-4f53-a465-1d6db43be137 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.260902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde61b9f-50a7-4f53-a465-1d6db43be137 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.261182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde61b9f-50a7-4f53-a465-1d6db43be137 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.265943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6351ab9a-6b1b-4dd9-9715-975599089546 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.270393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde61b9f-50a7-4f53-a465-1d6db43be137 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.271533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292ba12-ccec-4a5a-b8d5-12c3387b7036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.272325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292ba12-ccec-4a5a-b8d5-12c3387b7036 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.272632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde61b9f-50a7-4f53-a465-1d6db43be137 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.272899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292ba12-ccec-4a5a-b8d5-12c3387b7036 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.273307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1292ba12-ccec-4a5a-b8d5-12c3387b7036 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.274235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292ba12-ccec-4a5a-b8d5-12c3387b7036 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:06.274941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292ba12-ccec-4a5a-b8d5-12c3387b7036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.276643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1292ba12-ccec-4a5a-b8d5-12c3387b7036 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.282264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 36/76] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:06.283269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde61b9f-50a7-4f53-a465-1d6db43be137 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.290709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 41/77] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.291698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292ba12-ccec-4a5a-b8d5-12c3387b7036 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.296971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde61b9f-50a7-4f53-a465-1d6db43be137 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.306213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1292ba12-ccec-4a5a-b8d5-12c3387b7036 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.307322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.307992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.308277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.308633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.309668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] RBAC: Adding query filter params (role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025, user.id=73d3f947148f405db4b58b5f3f2f3c73) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:06.309989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.311207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_role_assignments failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:06.311207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:06.311207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:06.312543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.312904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3c69f-b0fa-4234-b930-e27b3dd9a1b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.314015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3c69f-b0fa-4234-b930-e27b3dd9a1b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.314532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3c69f-b0fa-4234-b930-e27b3dd9a1b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.315018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3c69f-b0fa-4234-b930-e27b3dd9a1b2 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.316639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3c69f-b0fa-4234-b930-e27b3dd9a1b2 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.320042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa3c69f-b0fa-4234-b930-e27b3dd9a1b2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.321388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 37/78] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/role_assignments?user.id=73d3f947148f405db4b58b5f3f2f3c73&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 259 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.322359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.328545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 42/79] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.329927 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3c69f-b0fa-4234-b930-e27b3dd9a1b2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.334137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a66b70-b900-430b-8f7a-8ddf61c8c8fb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.340286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c22a06-48a1-417c-962e-a0ab2c36ca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.341198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c22a06-48a1-417c-962e-a0ab2c36ca17 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.341485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c22a06-48a1-417c-962e-a0ab2c36ca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.341766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c22a06-48a1-417c-962e-a0ab2c36ca17 admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.343059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3c69f-b0fa-4234-b930-e27b3dd9a1b2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.343226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c22a06-48a1-417c-962e-a0ab2c36ca17 admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.345832 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c22a06-48a1-417c-962e-a0ab2c36ca17 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.348961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 38/80] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.349421 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf21fe-9788-45ad-91e6-b725f1e65438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.355980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf21fe-9788-45ad-91e6-b725f1e65438 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.356643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf21fe-9788-45ad-91e6-b725f1e65438 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.357146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf21fe-9788-45ad-91e6-b725f1e65438 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.358441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf21fe-9788-45ad-91e6-b725f1e65438 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025, user.id=5c3a6c2e10d54dfc8b895992ac771847) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:06.359018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf21fe-9788-45ad-91e6-b725f1e65438 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.359192 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c22a06-48a1-417c-962e-a0ab2c36ca17 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.361453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf21fe-9788-45ad-91e6-b725f1e65438 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.371007 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c22a06-48a1-417c-962e-a0ab2c36ca17 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.376511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062712d-4975-4644-9eb9-fcfe8d1eff9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.377512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062712d-4975-4644-9eb9-fcfe8d1eff9d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.377988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062712d-4975-4644-9eb9-fcfe8d1eff9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.378469 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f062712d-4975-4644-9eb9-fcfe8d1eff9d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.378875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 43/81] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/role_assignments?user.id=5c3a6c2e10d54dfc8b895992ac771847&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 259 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.388764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062712d-4975-4644-9eb9-fcfe8d1eff9d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.391073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f062712d-4975-4644-9eb9-fcfe8d1eff9d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.402292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 39/82] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:06.409190 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf21fe-9788-45ad-91e6-b725f1e65438 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.428658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf21fe-9788-45ad-91e6-b725f1e65438 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.444522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837e7b8-dc91-4e6a-ba59-d0fe8b1bdff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.445739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837e7b8-dc91-4e6a-ba59-d0fe8b1bdff5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.446286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837e7b8-dc91-4e6a-ba59-d0fe8b1bdff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.446781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837e7b8-dc91-4e6a-ba59-d0fe8b1bdff5 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.450982 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837e7b8-dc91-4e6a-ba59-d0fe8b1bdff5 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.453423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837e7b8-dc91-4e6a-ba59-d0fe8b1bdff5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.455493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 44/83] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.462791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062712d-4975-4644-9eb9-fcfe8d1eff9d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.472540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f062712d-4975-4644-9eb9-fcfe8d1eff9d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.482800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561c847-e4d0-4454-ae96-352da7b8984e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.483493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c847-e4d0-4454-ae96-352da7b8984e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.483776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c847-e4d0-4454-ae96-352da7b8984e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.484052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561c847-e4d0-4454-ae96-352da7b8984e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.485227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561c847-e4d0-4454-ae96-352da7b8984e admin admin] RBAC: Adding query filter params (role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025, user.id=73d3f947148f405db4b58b5f3f2f3c73) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:06.485762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561c847-e4d0-4454-ae96-352da7b8984e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.486625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0874886-1f3a-4192-82aa-47c5857e088e None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.486990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0874886-1f3a-4192-82aa-47c5857e088e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.487345 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0874886-1f3a-4192-82aa-47c5857e088e None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.489176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561c847-e4d0-4454-ae96-352da7b8984e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.490177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 45/84] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:06.496657 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 40/85] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/role_assignments?user.id=73d3f947148f405db4b58b5f3f2f3c73&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.503676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5e4b8-e8ca-4441-bd72-c30b29f5f4a0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.503960 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5e4b8-e8ca-4441-bd72-c30b29f5f4a0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.510836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d5e4b8-e8ca-4441-bd72-c30b29f5f4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.539316 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-24d5e4b8-e8ca-4441-bd72-c30b29f5f4a0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:06.540919 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-24d5e4b8-e8ca-4441-bd72-c30b29f5f4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:06.550349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 46/86] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:06.555173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1da5c7-614e-420f-86ff-c12761dc6808 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.555848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1da5c7-614e-420f-86ff-c12761dc6808 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.556325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1da5c7-614e-420f-86ff-c12761dc6808 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.558632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 41/87] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:06 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:06.565493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287d271-27ab-4c17-9343-bec0666424bd None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.565827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287d271-27ab-4c17-9343-bec0666424bd None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.566082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1287d271-27ab-4c17-9343-bec0666424bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.586131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1da5c7-614e-420f-86ff-c12761dc6808 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.592209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-1287d271-27ab-4c17-9343-bec0666424bd None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:06.593443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1287d271-27ab-4c17-9343-bec0666424bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:06.604705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1da5c7-614e-420f-86ff-c12761dc6808 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.609045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 47/88] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:06 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:06.609926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189963f-a4b0-4203-9063-f9252263b046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.610880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189963f-a4b0-4203-9063-f9252263b046 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.611325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189963f-a4b0-4203-9063-f9252263b046 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.611751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189963f-a4b0-4203-9063-f9252263b046 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.630761 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2189963f-a4b0-4203-9063-f9252263b046 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:06.636595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287d271-27ab-4c17-9343-bec0666424bd None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.638494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-2189963f-a4b0-4203-9063-f9252263b046 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:06.640016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 42/89] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/roles/member => generated 84 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:06.647063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1287d271-27ab-4c17-9343-bec0666424bd None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.647467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189963f-a4b0-4203-9063-f9252263b046 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.653372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65ae48-2050-47ea-b58b-75e54b5bb94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.654510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ae48-2050-47ea-b58b-75e54b5bb94f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.654795 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ae48-2050-47ea-b58b-75e54b5bb94f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.655071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65ae48-2050-47ea-b58b-75e54b5bb94f admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.657087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65ae48-2050-47ea-b58b-75e54b5bb94f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.660082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65ae48-2050-47ea-b58b-75e54b5bb94f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.661802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189963f-a4b0-4203-9063-f9252263b046 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.663299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 48/90] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:06.670010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65ae48-2050-47ea-b58b-75e54b5bb94f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.679315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae102-68fe-4919-b1ba-1f3f0a10f46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.680081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae102-68fe-4919-b1ba-1f3f0a10f46d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.680366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae102-68fe-4919-b1ba-1f3f0a10f46d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.682060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ae102-68fe-4919-b1ba-1f3f0a10f46d admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.682923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ae102-68fe-4919-b1ba-1f3f0a10f46d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:06.683240 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ae102-68fe-4919-b1ba-1f3f0a10f46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.688579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ae102-68fe-4919-b1ba-1f3f0a10f46d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.692954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65ae48-2050-47ea-b58b-75e54b5bb94f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.703386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642120ed-2e17-4df0-b21e-574440f39bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.705655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642120ed-2e17-4df0-b21e-574440f39bba admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.705942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642120ed-2e17-4df0-b21e-574440f39bba admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.706246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642120ed-2e17-4df0-b21e-574440f39bba admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.707053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 43/91] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:06.710756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642120ed-2e17-4df0-b21e-574440f39bba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.712786 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642120ed-2e17-4df0-b21e-574440f39bba admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.713653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae102-68fe-4919-b1ba-1f3f0a10f46d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.725890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ae102-68fe-4919-b1ba-1f3f0a10f46d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.743723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51411c63-9290-483e-9be1-38587c6df502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.744617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51411c63-9290-483e-9be1-38587c6df502 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.745009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51411c63-9290-483e-9be1-38587c6df502 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.745174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51411c63-9290-483e-9be1-38587c6df502 admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.748624 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51411c63-9290-483e-9be1-38587c6df502 admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.751417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51411c63-9290-483e-9be1-38587c6df502 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.752537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 44/92] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:06.760035 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51411c63-9290-483e-9be1-38587c6df502 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.770301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51411c63-9290-483e-9be1-38587c6df502 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.775219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754f2b8-7a2d-4cc1-9b22-26f3d5f27a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.776018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f2b8-7a2d-4cc1-9b22-26f3d5f27a8b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.776491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f2b8-7a2d-4cc1-9b22-26f3d5f27a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.776909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0754f2b8-7a2d-4cc1-9b22-26f3d5f27a8b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.786982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754f2b8-7a2d-4cc1-9b22-26f3d5f27a8b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.789195 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0754f2b8-7a2d-4cc1-9b22-26f3d5f27a8b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.799177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 45/93] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:00:06.811050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754f2b8-7a2d-4cc1-9b22-26f3d5f27a8b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.819840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0754f2b8-7a2d-4cc1-9b22-26f3d5f27a8b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.824483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a607a-0419-4a42-9c3f-7a027339957a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.825339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a607a-0419-4a42-9c3f-7a027339957a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.825618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a607a-0419-4a42-9c3f-7a027339957a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.825894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a607a-0419-4a42-9c3f-7a027339957a admin admin] PATH_INFO: `/v3/projects/b991dc97602e4f83a48dfb61d3218477` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.827196 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a607a-0419-4a42-9c3f-7a027339957a admin admin] RBAC: Authorizing `identity:get_project(project_id=b991dc97602e4f83a48dfb61d3218477)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.829271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a607a-0419-4a42-9c3f-7a027339957a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.830990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 46/94] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/projects/b991dc97602e4f83a48dfb61d3218477 => generated 312 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:06.837512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a607a-0419-4a42-9c3f-7a027339957a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:06.848837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 49/95] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:00:06 2021] POST /identity/v3/projects => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:00:06.852715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a607a-0419-4a42-9c3f-7a027339957a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:06.941120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209c3d25-c6a3-4c7d-9658-5a9852123057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:06.942529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c3d25-c6a3-4c7d-9658-5a9852123057 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:06.942881 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c3d25-c6a3-4c7d-9658-5a9852123057 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:06.943169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209c3d25-c6a3-4c7d-9658-5a9852123057 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:06.944000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c3d25-c6a3-4c7d-9658-5a9852123057 admin admin] RBAC: Adding query filter params (role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=b991dc97602e4f83a48dfb61d3218477, user.id=73d3f947148f405db4b58b5f3f2f3c73) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:06.944315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c3d25-c6a3-4c7d-9658-5a9852123057 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:06.946219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209c3d25-c6a3-4c7d-9658-5a9852123057 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:06.959355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 47/96] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:06 2021] GET /identity/v3/role_assignments?user.id=73d3f947148f405db4b58b5f3f2f3c73&scope.project.id=b991dc97602e4f83a48dfb61d3218477&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 259 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:09.120522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed8e61-74c0-4cd6-b0a3-fea26083621e None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.121531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed8e61-74c0-4cd6-b0a3-fea26083621e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.122008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed8e61-74c0-4cd6-b0a3-fea26083621e None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.124254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 50/97] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:09.131308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22585ca-fc41-409a-bab8-0861f0da71f2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.132141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22585ca-fc41-409a-bab8-0861f0da71f2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.132570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22585ca-fc41-409a-bab8-0861f0da71f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.142979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d4b24-82ff-4dbe-ba7c-1aab91c33eaa None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.143569 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d4b24-82ff-4dbe-ba7c-1aab91c33eaa None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.144065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35d4b24-82ff-4dbe-ba7c-1aab91c33eaa None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.146678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 51/98] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:09 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:09.153208 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104d03a-1be5-4567-b93c-81ae86f11f30 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.153753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104d03a-1be5-4567-b93c-81ae86f11f30 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.154267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104d03a-1be5-4567-b93c-81ae86f11f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.173054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e22585ca-fc41-409a-bab8-0861f0da71f2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:09.177860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e22585ca-fc41-409a-bab8-0861f0da71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:09.179783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d104d03a-1be5-4567-b93c-81ae86f11f30 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:09.182009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d104d03a-1be5-4567-b93c-81ae86f11f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:09.193875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 48/99] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:09.203910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 52/100] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:09.240582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22585ca-fc41-409a-bab8-0861f0da71f2 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.246078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104d03a-1be5-4567-b93c-81ae86f11f30 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.255886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22585ca-fc41-409a-bab8-0861f0da71f2 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.260753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104d03a-1be5-4567-b93c-81ae86f11f30 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.266266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87402e5-a020-4e21-aac3-491e515a8769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.267309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87402e5-a020-4e21-aac3-491e515a8769 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.267796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87402e5-a020-4e21-aac3-491e515a8769 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.268331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87402e5-a020-4e21-aac3-491e515a8769 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.273383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3a546-88f6-4944-b9d7-4ffbde79a5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.274699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3a546-88f6-4944-b9d7-4ffbde79a5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.275186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3a546-88f6-4944-b9d7-4ffbde79a5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.277759 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad3a546-88f6-4944-b9d7-4ffbde79a5c5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.290699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87402e5-a020-4e21-aac3-491e515a8769 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:09.299829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-a87402e5-a020-4e21-aac3-491e515a8769 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:09.305017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad3a546-88f6-4944-b9d7-4ffbde79a5c5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:09.312504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-4ad3a546-88f6-4944-b9d7-4ffbde79a5c5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:09.313697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 49/101] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:09.315408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 53/102] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:09.323178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87402e5-a020-4e21-aac3-491e515a8769 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.325889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3a546-88f6-4944-b9d7-4ffbde79a5c5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.336565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad3a546-88f6-4944-b9d7-4ffbde79a5c5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.339002 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87402e5-a020-4e21-aac3-491e515a8769 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.341518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf213e2d-a697-4aa3-8f40-9365800f6f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.342213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf213e2d-a697-4aa3-8f40-9365800f6f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.342495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf213e2d-a697-4aa3-8f40-9365800f6f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.342770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf213e2d-a697-4aa3-8f40-9365800f6f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.343529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf213e2d-a697-4aa3-8f40-9365800f6f40 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:09.343832 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf213e2d-a697-4aa3-8f40-9365800f6f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.345435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf213e2d-a697-4aa3-8f40-9365800f6f40 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.351656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a3bb9-4345-426b-9376-a89abfeb0e87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.352617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a3bb9-4345-426b-9376-a89abfeb0e87 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.353103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a3bb9-4345-426b-9376-a89abfeb0e87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.353595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8a3bb9-4345-426b-9376-a89abfeb0e87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.354481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a3bb9-4345-426b-9376-a89abfeb0e87 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:09.354975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a3bb9-4345-426b-9376-a89abfeb0e87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.356772 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8a3bb9-4345-426b-9376-a89abfeb0e87 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.357492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 54/103] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:09.363886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf213e2d-a697-4aa3-8f40-9365800f6f40 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.373478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf213e2d-a697-4aa3-8f40-9365800f6f40 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.375930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 50/104] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:09.383037 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a3bb9-4345-426b-9376-a89abfeb0e87 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.383993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0ec6d-3d7b-41c9-a6d3-1ed2ada2963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.385288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0ec6d-3d7b-41c9-a6d3-1ed2ada2963a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.385774 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0ec6d-3d7b-41c9-a6d3-1ed2ada2963a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.386283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0ec6d-3d7b-41c9-a6d3-1ed2ada2963a admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.387754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0ec6d-3d7b-41c9-a6d3-1ed2ada2963a admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.389918 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0ec6d-3d7b-41c9-a6d3-1ed2ada2963a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.391893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 55/105] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:09.400570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0ec6d-3d7b-41c9-a6d3-1ed2ada2963a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.400788 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8a3bb9-4345-426b-9376-a89abfeb0e87 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.413856 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0ec6d-3d7b-41c9-a6d3-1ed2ada2963a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.416140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896cfc9-a344-41af-8461-65785dbf99d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.417025 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896cfc9-a344-41af-8461-65785dbf99d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.417313 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896cfc9-a344-41af-8461-65785dbf99d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.417590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896cfc9-a344-41af-8461-65785dbf99d5 admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.419511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24342f-7ee8-4bf6-b84e-115cfa3f468b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.420558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24342f-7ee8-4bf6-b84e-115cfa3f468b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.421044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24342f-7ee8-4bf6-b84e-115cfa3f468b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.421517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24342f-7ee8-4bf6-b84e-115cfa3f468b admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.422869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896cfc9-a344-41af-8461-65785dbf99d5 admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.423171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24342f-7ee8-4bf6-b84e-115cfa3f468b admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.425038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1896cfc9-a344-41af-8461-65785dbf99d5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.425652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24342f-7ee8-4bf6-b84e-115cfa3f468b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.427182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 51/106] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:09.434414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 56/107] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:09.435322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896cfc9-a344-41af-8461-65785dbf99d5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.439801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24342f-7ee8-4bf6-b84e-115cfa3f468b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.450067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24342f-7ee8-4bf6-b84e-115cfa3f468b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.454950 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2a19b2-e4c1-4bc0-8ac7-e2b9aa78f8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.456035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a19b2-e4c1-4bc0-8ac7-e2b9aa78f8d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.456429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896cfc9-a344-41af-8461-65785dbf99d5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.456642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a19b2-e4c1-4bc0-8ac7-e2b9aa78f8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.460514 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2a19b2-e4c1-4bc0-8ac7-e2b9aa78f8d3 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/users/5c3a6c2e10d54dfc8b895992ac771847/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.460514 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a19b2-e4c1-4bc0-8ac7-e2b9aa78f8d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4f8cf5773f4074b83a335c1b11f025, user_id=5c3a6c2e10d54dfc8b895992ac771847, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.460829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-8d2a19b2-e4c1-4bc0-8ac7-e2b9aa78f8d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_grant failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:09.460829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:00:09.460829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:00:09.462769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2a19b2-e4c1-4bc0-8ac7-e2b9aa78f8d3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.471303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa80649-d64c-48b1-a562-6f8022344a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.472238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa80649-d64c-48b1-a562-6f8022344a4c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.472520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa80649-d64c-48b1-a562-6f8022344a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.473529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa80649-d64c-48b1-a562-6f8022344a4c admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.474841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa80649-d64c-48b1-a562-6f8022344a4c admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.476961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa80649-d64c-48b1-a562-6f8022344a4c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.478753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 52/108] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:09.485212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa80649-d64c-48b1-a562-6f8022344a4c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.495821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa80649-d64c-48b1-a562-6f8022344a4c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.500217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b15be-3d8d-492c-9491-a0f07b72e6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.501084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b15be-3d8d-492c-9491-a0f07b72e6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.501363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b15be-3d8d-492c-9491-a0f07b72e6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.501628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b15be-3d8d-492c-9491-a0f07b72e6e5 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/users/73d3f947148f405db4b58b5f3f2f3c73/roles/3e47746460b74dbb90c678ac5b65a01a` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.503841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b15be-3d8d-492c-9491-a0f07b72e6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4f8cf5773f4074b83a335c1b11f025, user_id=73d3f947148f405db4b58b5f3f2f3c73, role_id=3e47746460b74dbb90c678ac5b65a01a)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.507322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b15be-3d8d-492c-9491-a0f07b72e6e5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.652031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 57/109] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:09 2021] PUT /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/users/5c3a6c2e10d54dfc8b895992ac771847/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:09.659864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829be8d2-2bb8-49a0-954a-7239e60a62c3 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.660756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829be8d2-2bb8-49a0-954a-7239e60a62c3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.661046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829be8d2-2bb8-49a0-954a-7239e60a62c3 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.663267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 58/110] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:09.670291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcc34d-27ed-4ab3-b7f4-b2cadc436e68 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.670935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcc34d-27ed-4ab3-b7f4-b2cadc436e68 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.671416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bcc34d-27ed-4ab3-b7f4-b2cadc436e68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.692501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-97bcc34d-27ed-4ab3-b7f4-b2cadc436e68 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:09.700435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-97bcc34d-27ed-4ab3-b7f4-b2cadc436e68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:09.702564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 53/111] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:09 2021] PUT /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/users/73d3f947148f405db4b58b5f3f2f3c73/roles/3e47746460b74dbb90c678ac5b65a01a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:09.755786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f843-3921-4138-9086-f135aa8f58a1 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.756131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f843-3921-4138-9086-f135aa8f58a1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.756365 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f27f843-3921-4138-9086-f135aa8f58a1 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.758373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 54/112] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:09 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:09.766627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136150e-e43f-4fce-8134-4ea90e89263f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.766627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136150e-e43f-4fce-8134-4ea90e89263f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.766627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136150e-e43f-4fce-8134-4ea90e89263f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.776045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 59/113] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:09.793724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2136150e-e43f-4fce-8134-4ea90e89263f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:09.795010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2136150e-e43f-4fce-8134-4ea90e89263f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:09.804908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 55/114] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:09.820080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcc34d-27ed-4ab3-b7f4-b2cadc436e68 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.829945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bcc34d-27ed-4ab3-b7f4-b2cadc436e68 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.839310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a893418-d0f6-4fc3-aedc-3ff088b0cc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.840141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a893418-d0f6-4fc3-aedc-3ff088b0cc16 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.840422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a893418-d0f6-4fc3-aedc-3ff088b0cc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.840697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a893418-d0f6-4fc3-aedc-3ff088b0cc16 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.857562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a893418-d0f6-4fc3-aedc-3ff088b0cc16 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:09.865276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-0a893418-d0f6-4fc3-aedc-3ff088b0cc16 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:09.866602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 60/115] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:09.871379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136150e-e43f-4fce-8134-4ea90e89263f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.873451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a893418-d0f6-4fc3-aedc-3ff088b0cc16 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.884313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a893418-d0f6-4fc3-aedc-3ff088b0cc16 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.888468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136150e-e43f-4fce-8134-4ea90e89263f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.889853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03eab3c-455b-4ca2-ba1c-d5c0482c6551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.890824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eab3c-455b-4ca2-ba1c-d5c0482c6551 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.891409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eab3c-455b-4ca2-ba1c-d5c0482c6551 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.891912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03eab3c-455b-4ca2-ba1c-d5c0482c6551 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.893290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eab3c-455b-4ca2-ba1c-d5c0482c6551 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:09.893811 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eab3c-455b-4ca2-ba1c-d5c0482c6551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.896668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03eab3c-455b-4ca2-ba1c-d5c0482c6551 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.898826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8086d2-950b-4606-9cc1-d45df596fae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.899901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8086d2-950b-4606-9cc1-d45df596fae9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.900184 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8086d2-950b-4606-9cc1-d45df596fae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.900454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8086d2-950b-4606-9cc1-d45df596fae9 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.908362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 61/116] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:09.910411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9a9a1-7d21-49a8-9707-7f64ee29d691 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.914121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9a9a1-7d21-49a8-9707-7f64ee29d691 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.915309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8086d2-950b-4606-9cc1-d45df596fae9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:09.916933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e9a9a1-7d21-49a8-9707-7f64ee29d691 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.919034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 62/117] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:09 2021] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:09.924734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9a9a1-7d21-49a8-9707-7f64ee29d691 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.929092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-1f8086d2-950b-4606-9cc1-d45df596fae9 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:09.931044 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 56/118] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/roles/member => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:09.932571 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28766b20-e6a5-4eff-a9de-1c9f110d49a1 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.933020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28766b20-e6a5-4eff-a9de-1c9f110d49a1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.933497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28766b20-e6a5-4eff-a9de-1c9f110d49a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.933971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e9a9a1-7d21-49a8-9707-7f64ee29d691 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.938707 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0b38f-328a-43ed-b9bb-a7f49e075ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.939856 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0b38f-328a-43ed-b9bb-a7f49e075ecc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.940244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0b38f-328a-43ed-b9bb-a7f49e075ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.940623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0b38f-328a-43ed-b9bb-a7f49e075ecc admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.942589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0b38f-328a-43ed-b9bb-a7f49e075ecc admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.945095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d0b38f-328a-43ed-b9bb-a7f49e075ecc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.947023 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 63/119] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:09.947946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0b38f-328a-43ed-b9bb-a7f49e075ecc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.956373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-28766b20-e6a5-4eff-a9de-1c9f110d49a1 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:09.958985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-28766b20-e6a5-4eff-a9de-1c9f110d49a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:09.965671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0b38f-328a-43ed-b9bb-a7f49e075ecc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.968053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 57/120] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:09 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:09.974060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28766b20-e6a5-4eff-a9de-1c9f110d49a1 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:09.974276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd9541-e715-42ac-81ff-279d9fe91226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:09.974276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd9541-e715-42ac-81ff-279d9fe91226 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:09.974276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd9541-e715-42ac-81ff-279d9fe91226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:09.974276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fd9541-e715-42ac-81ff-279d9fe91226 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:09.974589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd9541-e715-42ac-81ff-279d9fe91226 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:09.974589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd9541-e715-42ac-81ff-279d9fe91226 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:09.975488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fd9541-e715-42ac-81ff-279d9fe91226 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:09.984725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 64/121] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:09.989878 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28766b20-e6a5-4eff-a9de-1c9f110d49a1 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:09.992895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd9541-e715-42ac-81ff-279d9fe91226 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:10.007784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172edba7-8df5-47e2-8d2e-6809e93a0fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:10.008720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172edba7-8df5-47e2-8d2e-6809e93a0fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:10.008947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172edba7-8df5-47e2-8d2e-6809e93a0fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:10.009220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172edba7-8df5-47e2-8d2e-6809e93a0fd4 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:10.011853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fd9541-e715-42ac-81ff-279d9fe91226 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:10.013140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172edba7-8df5-47e2-8d2e-6809e93a0fd4 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:10.015442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172edba7-8df5-47e2-8d2e-6809e93a0fd4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:10.017433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 58/122] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:10.018267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172edba7-8df5-47e2-8d2e-6809e93a0fd4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:10.018669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6c801-62ee-49ca-9f4e-564a9c3aa0fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:10.020520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6c801-62ee-49ca-9f4e-564a9c3aa0fc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:10.020813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6c801-62ee-49ca-9f4e-564a9c3aa0fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:10.021208 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6c801-62ee-49ca-9f4e-564a9c3aa0fc admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:10.022656 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6c801-62ee-49ca-9f4e-564a9c3aa0fc admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:10.026917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6c801-62ee-49ca-9f4e-564a9c3aa0fc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:10.028460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 65/123] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:09 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:10.030892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6c801-62ee-49ca-9f4e-564a9c3aa0fc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:10.031012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172edba7-8df5-47e2-8d2e-6809e93a0fd4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:10.036515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f51d5b-acd5-4bc5-bfa6-5bed578ca662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:10.037571 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f51d5b-acd5-4bc5-bfa6-5bed578ca662 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:10.038115 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f51d5b-acd5-4bc5-bfa6-5bed578ca662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:10.038589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f51d5b-acd5-4bc5-bfa6-5bed578ca662 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:10.040110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f51d5b-acd5-4bc5-bfa6-5bed578ca662 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:10.042192 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f51d5b-acd5-4bc5-bfa6-5bed578ca662 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:10.044123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 59/124] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:10 2021] GET /identity/v3/domains/default => generated 199 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:10.044376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6c801-62ee-49ca-9f4e-564a9c3aa0fc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:10.045526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f51d5b-acd5-4bc5-bfa6-5bed578ca662 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:10.048780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b11966-f62a-4bbb-b432-67ee13a98a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:10.049666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b11966-f62a-4bbb-b432-67ee13a98a82 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:10.049952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b11966-f62a-4bbb-b432-67ee13a98a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:10.050257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b11966-f62a-4bbb-b432-67ee13a98a82 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/users/73d3f947148f405db4b58b5f3f2f3c73/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:10.052983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b11966-f62a-4bbb-b432-67ee13a98a82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4f8cf5773f4074b83a335c1b11f025, user_id=73d3f947148f405db4b58b5f3f2f3c73, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:10.055874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b11966-f62a-4bbb-b432-67ee13a98a82 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:10.057936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f51d5b-acd5-4bc5-bfa6-5bed578ca662 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:10.062938 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415051e-78d2-418e-9061-0190d95f0f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:10.063858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415051e-78d2-418e-9061-0190d95f0f78 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:10.064213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415051e-78d2-418e-9061-0190d95f0f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:10.064557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d415051e-78d2-418e-9061-0190d95f0f78 admin admin] PATH_INFO: `/v3/projects/b991dc97602e4f83a48dfb61d3218477` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:10.065824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415051e-78d2-418e-9061-0190d95f0f78 admin admin] RBAC: Authorizing `identity:get_project(project_id=b991dc97602e4f83a48dfb61d3218477)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:10.068468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d415051e-78d2-418e-9061-0190d95f0f78 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:10.082117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 60/125] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:10 2021] GET /identity/v3/projects/b991dc97602e4f83a48dfb61d3218477 => generated 312 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:10.082117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415051e-78d2-418e-9061-0190d95f0f78 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:10.082117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d415051e-78d2-418e-9061-0190d95f0f78 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:10.085779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e6bd6-8aa4-4654-be2e-a4ce22719c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:10.086450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6bd6-8aa4-4654-be2e-a4ce22719c2f admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:10.086735 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6bd6-8aa4-4654-be2e-a4ce22719c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:10.087013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e6bd6-8aa4-4654-be2e-a4ce22719c2f admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:10.087726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e6bd6-8aa4-4654-be2e-a4ce22719c2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:10.088717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-e41e6bd6-8aa4-4654-be2e-a4ce22719c2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:10.088717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:10.088717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:10.089898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e6bd6-8aa4-4654-be2e-a4ce22719c2f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:10.148851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 66/126] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:10 2021] PUT /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/users/73d3f947148f405db4b58b5f3f2f3c73/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:10.150636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b11966-f62a-4bbb-b432-67ee13a98a82 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:10.180144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 61/127] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:00:10 2021] POST /identity/v3/users => generated 283 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:00:10.243753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b11966-f62a-4bbb-b432-67ee13a98a82 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:10.248544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9da5ad-d6b5-424c-9883-b8dbd8d34587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:10.249464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9da5ad-d6b5-424c-9883-b8dbd8d34587 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:10.249753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9da5ad-d6b5-424c-9883-b8dbd8d34587 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:10.250053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9da5ad-d6b5-424c-9883-b8dbd8d34587 admin admin] PATH_INFO: `/v3/projects/b991dc97602e4f83a48dfb61d3218477/users/73d3f947148f405db4b58b5f3f2f3c73/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:10.252241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9da5ad-d6b5-424c-9883-b8dbd8d34587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b991dc97602e4f83a48dfb61d3218477, user_id=73d3f947148f405db4b58b5f3f2f3c73, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:10.256089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9da5ad-d6b5-424c-9883-b8dbd8d34587 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:10.349744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 67/128] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:10 2021] PUT /identity/v3/projects/b991dc97602e4f83a48dfb61d3218477/users/73d3f947148f405db4b58b5f3f2f3c73/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:12.702969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b1a1d-216f-416e-b30f-2e10f9f191d1 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:12.703518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b1a1d-216f-416e-b30f-2e10f9f191d1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:12.703518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3b1a1d-216f-416e-b30f-2e10f9f191d1 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:12.705373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 62/129] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:12.723957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad2e18-e9f8-4e19-b4cb-4816a5c0baf3 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:12.724603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad2e18-e9f8-4e19-b4cb-4816a5c0baf3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:12.724603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad2e18-e9f8-4e19-b4cb-4816a5c0baf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:12.754610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-65ad2e18-e9f8-4e19-b4cb-4816a5c0baf3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:12.755990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-65ad2e18-e9f8-4e19-b4cb-4816a5c0baf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:12.824454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 68/130] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:12 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:12.863091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b1a1d-216f-416e-b30f-2e10f9f191d1 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:12.876215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3b1a1d-216f-416e-b30f-2e10f9f191d1 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:12.881599 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c61e-5263-44de-9ccd-6f97c51ed584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:12.882480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c61e-5263-44de-9ccd-6f97c51ed584 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:12.882761 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c61e-5263-44de-9ccd-6f97c51ed584 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:12.883039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c61e-5263-44de-9ccd-6f97c51ed584 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:12.894082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9c61e-5263-44de-9ccd-6f97c51ed584 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:12.901640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-46c9c61e-5263-44de-9ccd-6f97c51ed584 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:12.903271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 63/131] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:12 2021] GET /identity/v3/roles/admin => generated 83 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:12.909314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad2e18-e9f8-4e19-b4cb-4816a5c0baf3 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:12.923020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad2e18-e9f8-4e19-b4cb-4816a5c0baf3 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:12.928220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf21b1-1ac9-4a1c-ab3b-15318631d432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:12.928893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf21b1-1ac9-4a1c-ab3b-15318631d432 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:12.929175 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf21b1-1ac9-4a1c-ab3b-15318631d432 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:12.929450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf21b1-1ac9-4a1c-ab3b-15318631d432 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:12.930301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf21b1-1ac9-4a1c-ab3b-15318631d432 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:12.930610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf21b1-1ac9-4a1c-ab3b-15318631d432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:12.932215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf21b1-1ac9-4a1c-ab3b-15318631d432 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:12.945561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 69/132] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:12 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:12.958042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c61e-5263-44de-9ccd-6f97c51ed584 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:12.968587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c61e-5263-44de-9ccd-6f97c51ed584 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:12.977612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bbf71-fac3-46f0-8932-cf0b7eeaaaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:12.978509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bbf71-fac3-46f0-8932-cf0b7eeaaaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:12.978789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bbf71-fac3-46f0-8932-cf0b7eeaaaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:12.979064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bbf71-fac3-46f0-8932-cf0b7eeaaaf1 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:12.980269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bbf71-fac3-46f0-8932-cf0b7eeaaaf1 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:12.987049 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bbf71-fac3-46f0-8932-cf0b7eeaaaf1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:12.989668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 64/133] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:12 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:12.995535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf21b1-1ac9-4a1c-ab3b-15318631d432 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.013183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf4956-6545-45af-a693-9f34c9a5a256 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.013471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf4956-6545-45af-a693-9f34c9a5a256 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.013733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf4956-6545-45af-a693-9f34c9a5a256 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.015654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 65/134] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:13.020781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf21b1-1ac9-4a1c-ab3b-15318631d432 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.030658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3f6b-9031-4354-9e5b-7788d6bc399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.031602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3f6b-9031-4354-9e5b-7788d6bc399a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.031800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97bdb1-7780-458d-a510-224e48fc651c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.032089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97bdb1-7780-458d-a510-224e48fc651c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.032370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97bdb1-7780-458d-a510-224e48fc651c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.032662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3f6b-9031-4354-9e5b-7788d6bc399a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.033228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc3f6b-9031-4354-9e5b-7788d6bc399a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.049501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc3f6b-9031-4354-9e5b-7788d6bc399a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.051405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-be97bdb1-7780-458d-a510-224e48fc651c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:13.052425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-be97bdb1-7780-458d-a510-224e48fc651c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:13.052849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc3f6b-9031-4354-9e5b-7788d6bc399a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.066270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 70/135] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:12 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:13.070091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 66/136] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:13.072849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3f6b-9031-4354-9e5b-7788d6bc399a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.082790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc3f6b-9031-4354-9e5b-7788d6bc399a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.089945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253e10c-c0a7-4f77-8dfb-f7e57fdb221b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.091076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253e10c-c0a7-4f77-8dfb-f7e57fdb221b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.091552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253e10c-c0a7-4f77-8dfb-f7e57fdb221b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.092015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4253e10c-c0a7-4f77-8dfb-f7e57fdb221b admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.098886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253e10c-c0a7-4f77-8dfb-f7e57fdb221b admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.101208 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4253e10c-c0a7-4f77-8dfb-f7e57fdb221b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.103430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 71/137] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:13.109484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97bdb1-7780-458d-a510-224e48fc651c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.119693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97bdb1-7780-458d-a510-224e48fc651c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.127779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253e10c-c0a7-4f77-8dfb-f7e57fdb221b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.130761 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e25fa5-06bc-413a-9dc5-df1333f767b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.131420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e25fa5-06bc-413a-9dc5-df1333f767b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.131701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e25fa5-06bc-413a-9dc5-df1333f767b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.131978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e25fa5-06bc-413a-9dc5-df1333f767b2 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.132817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e25fa5-06bc-413a-9dc5-df1333f767b2 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025, user.id=5c3a6c2e10d54dfc8b895992ac771847) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:13.133126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e25fa5-06bc-413a-9dc5-df1333f767b2 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.138050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e25fa5-06bc-413a-9dc5-df1333f767b2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.143115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4253e10c-c0a7-4f77-8dfb-f7e57fdb221b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.147308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 67/138] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/role_assignments?user.id=5c3a6c2e10d54dfc8b895992ac771847&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 608 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:13.156770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f966-1b03-4176-aad1-e289c5d28b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.157930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f966-1b03-4176-aad1-e289c5d28b59 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.158430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f966-1b03-4176-aad1-e289c5d28b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.158897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888f966-1b03-4176-aad1-e289c5d28b59 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.178990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888f966-1b03-4176-aad1-e289c5d28b59 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:13.189271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-8888f966-1b03-4176-aad1-e289c5d28b59 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:13.190574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 72/139] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:13.197749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e25fa5-06bc-413a-9dc5-df1333f767b2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.212607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e25fa5-06bc-413a-9dc5-df1333f767b2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.217100 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec57e10-2077-4a43-8eb1-c4f270d68372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.217775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec57e10-2077-4a43-8eb1-c4f270d68372 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.218074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec57e10-2077-4a43-8eb1-c4f270d68372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.218354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec57e10-2077-4a43-8eb1-c4f270d68372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.219119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec57e10-2077-4a43-8eb1-c4f270d68372 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:13.219425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec57e10-2077-4a43-8eb1-c4f270d68372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.221010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec57e10-2077-4a43-8eb1-c4f270d68372 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.235475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 68/140] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:13.242787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f966-1b03-4176-aad1-e289c5d28b59 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.259605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888f966-1b03-4176-aad1-e289c5d28b59 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.270904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38002a1-928e-4ed5-8a08-734e6a86ee65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.271790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38002a1-928e-4ed5-8a08-734e6a86ee65 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.272073 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38002a1-928e-4ed5-8a08-734e6a86ee65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.272347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38002a1-928e-4ed5-8a08-734e6a86ee65 admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.277625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38002a1-928e-4ed5-8a08-734e6a86ee65 admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.279803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38002a1-928e-4ed5-8a08-734e6a86ee65 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.281423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 73/141] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:13.288514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec57e10-2077-4a43-8eb1-c4f270d68372 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.303987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec57e10-2077-4a43-8eb1-c4f270d68372 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.308721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b370d-8a84-4c8d-8930-25f4f1b7634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.309405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b370d-8a84-4c8d-8930-25f4f1b7634d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.309689 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b370d-8a84-4c8d-8930-25f4f1b7634d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.309968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b370d-8a84-4c8d-8930-25f4f1b7634d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.323052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b370d-8a84-4c8d-8930-25f4f1b7634d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.324902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b370d-8a84-4c8d-8930-25f4f1b7634d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.340596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 69/142] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:13.347043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38002a1-928e-4ed5-8a08-734e6a86ee65 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.363105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38002a1-928e-4ed5-8a08-734e6a86ee65 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.374460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76196ee0-e169-4c32-84d3-abefe27d7446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.375346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196ee0-e169-4c32-84d3-abefe27d7446 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.375628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196ee0-e169-4c32-84d3-abefe27d7446 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.375905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76196ee0-e169-4c32-84d3-abefe27d7446 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.382868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76196ee0-e169-4c32-84d3-abefe27d7446 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.384976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76196ee0-e169-4c32-84d3-abefe27d7446 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.386827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 74/143] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:13.393779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b370d-8a84-4c8d-8930-25f4f1b7634d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.403532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b370d-8a84-4c8d-8930-25f4f1b7634d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.408126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede237d-da6b-4544-9524-40b0b95c5ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.408787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede237d-da6b-4544-9524-40b0b95c5ba7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.409069 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede237d-da6b-4544-9524-40b0b95c5ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.409346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede237d-da6b-4544-9524-40b0b95c5ba7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.410945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede237d-da6b-4544-9524-40b0b95c5ba7 admin admin] RBAC: Adding query filter params (role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025, user.id=73d3f947148f405db4b58b5f3f2f3c73) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:13.411365 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede237d-da6b-4544-9524-40b0b95c5ba7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.413257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede237d-da6b-4544-9524-40b0b95c5ba7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.426442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 70/144] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/role_assignments?user.id=73d3f947148f405db4b58b5f3f2f3c73&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:13.550321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e935d25-7518-432c-a4bf-b2087a825891 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.551254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e935d25-7518-432c-a4bf-b2087a825891 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.551421 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e935d25-7518-432c-a4bf-b2087a825891 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.553262 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 75/145] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:13.560340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5e316-0fb3-47e8-af42-5b0466dfcc6b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.560677 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5e316-0fb3-47e8-af42-5b0466dfcc6b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.560903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5e316-0fb3-47e8-af42-5b0466dfcc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.583941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-67a5e316-0fb3-47e8-af42-5b0466dfcc6b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:13.585135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-67a5e316-0fb3-47e8-af42-5b0466dfcc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:13.593229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 71/146] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:13 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:13.635565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e935d25-7518-432c-a4bf-b2087a825891 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.651756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e935d25-7518-432c-a4bf-b2087a825891 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.663259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f42672-ce2c-4fe4-967b-7f9519dc0f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.664068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f42672-ce2c-4fe4-967b-7f9519dc0f6d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.664347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f42672-ce2c-4fe4-967b-7f9519dc0f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.664619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f42672-ce2c-4fe4-967b-7f9519dc0f6d admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.679443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f42672-ce2c-4fe4-967b-7f9519dc0f6d admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:13.686475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-b9f42672-ce2c-4fe4-967b-7f9519dc0f6d admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:13.687705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 76/147] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/roles/member => generated 84 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:13.694370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5e316-0fb3-47e8-af42-5b0466dfcc6b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.706268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5e316-0fb3-47e8-af42-5b0466dfcc6b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.717881 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f22cf-3322-4a9b-9561-6eea4b843966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.718611 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f22cf-3322-4a9b-9561-6eea4b843966 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.718950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f22cf-3322-4a9b-9561-6eea4b843966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.719230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69f22cf-3322-4a9b-9561-6eea4b843966 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.720009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f22cf-3322-4a9b-9561-6eea4b843966 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:13.720316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f22cf-3322-4a9b-9561-6eea4b843966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.721938 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69f22cf-3322-4a9b-9561-6eea4b843966 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.732211 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 72/148] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:13.738677 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f42672-ce2c-4fe4-967b-7f9519dc0f6d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.751562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f42672-ce2c-4fe4-967b-7f9519dc0f6d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.762512 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efca8-5ad2-4e1f-8184-634ebc4dc45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.763416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efca8-5ad2-4e1f-8184-634ebc4dc45c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.763699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efca8-5ad2-4e1f-8184-634ebc4dc45c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.763977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079efca8-5ad2-4e1f-8184-634ebc4dc45c admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.766715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079efca8-5ad2-4e1f-8184-634ebc4dc45c admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.768942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079efca8-5ad2-4e1f-8184-634ebc4dc45c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.771358 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 77/149] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:13.779375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f22cf-3322-4a9b-9561-6eea4b843966 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.794164 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69f22cf-3322-4a9b-9561-6eea4b843966 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.798935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22796f-8b5d-46ae-8a58-1d01da70ab7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.799599 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22796f-8b5d-46ae-8a58-1d01da70ab7f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.800119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22796f-8b5d-46ae-8a58-1d01da70ab7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.800462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22796f-8b5d-46ae-8a58-1d01da70ab7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.810911 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22796f-8b5d-46ae-8a58-1d01da70ab7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.812684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22796f-8b5d-46ae-8a58-1d01da70ab7f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.824946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 73/150] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:13.831428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efca8-5ad2-4e1f-8184-634ebc4dc45c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.851388 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079efca8-5ad2-4e1f-8184-634ebc4dc45c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.861824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f69f62-bad5-4cdc-9a3d-91439e0e8d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.862739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69f62-bad5-4cdc-9a3d-91439e0e8d28 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.863028 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69f62-bad5-4cdc-9a3d-91439e0e8d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.863900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f69f62-bad5-4cdc-9a3d-91439e0e8d28 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.870884 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69f62-bad5-4cdc-9a3d-91439e0e8d28 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.872956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f69f62-bad5-4cdc-9a3d-91439e0e8d28 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.874902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 78/151] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:13.882195 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22796f-8b5d-46ae-8a58-1d01da70ab7f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:13.891500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22796f-8b5d-46ae-8a58-1d01da70ab7f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:13.905267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88a11b7-989e-4dbb-bc24-07484d2f457b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:13.905941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a11b7-989e-4dbb-bc24-07484d2f457b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:13.906258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a11b7-989e-4dbb-bc24-07484d2f457b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:13.906538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a11b7-989e-4dbb-bc24-07484d2f457b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:13.907441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a11b7-989e-4dbb-bc24-07484d2f457b admin admin] RBAC: Adding query filter params (role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025, user.id=73d3f947148f405db4b58b5f3f2f3c73) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:13.907756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a11b7-989e-4dbb-bc24-07484d2f457b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:13.909614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88a11b7-989e-4dbb-bc24-07484d2f457b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:13.921061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 74/152] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:13 2021] GET /identity/v3/role_assignments?user.id=73d3f947148f405db4b58b5f3f2f3c73&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:14.422506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d6db-88bf-4ebb-bfc5-9ec856f0ef08 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.422900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d6db-88bf-4ebb-bfc5-9ec856f0ef08 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.423065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c556d6db-88bf-4ebb-bfc5-9ec856f0ef08 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.424954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 79/153] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:14.445357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54809b-4e31-4c29-936a-7206971c1e12 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.445645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54809b-4e31-4c29-936a-7206971c1e12 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.445892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc54809b-4e31-4c29-936a-7206971c1e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.468819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-fc54809b-4e31-4c29-936a-7206971c1e12 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:14.470005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-fc54809b-4e31-4c29-936a-7206971c1e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:14.484430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 75/154] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:14.489846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449711e5-55fe-44b0-b069-31134d293c52 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.490154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449711e5-55fe-44b0-b069-31134d293c52 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.490435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449711e5-55fe-44b0-b069-31134d293c52 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.492322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 80/155] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:14 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:14.498222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fbae-637f-4231-ac81-dd3d5963c410 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.498515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fbae-637f-4231-ac81-dd3d5963c410 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.498798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929fbae-637f-4231-ac81-dd3d5963c410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.513137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449711e5-55fe-44b0-b069-31134d293c52 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.526385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-6929fbae-637f-4231-ac81-dd3d5963c410 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:14.527568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6929fbae-637f-4231-ac81-dd3d5963c410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:14.539612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449711e5-55fe-44b0-b069-31134d293c52 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.540546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 76/156] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:14 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:14.551387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90f2a9-803b-46ed-b133-d0278ef0eff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.552275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90f2a9-803b-46ed-b133-d0278ef0eff6 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.552551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90f2a9-803b-46ed-b133-d0278ef0eff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.552821 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f90f2a9-803b-46ed-b133-d0278ef0eff6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.564770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f90f2a9-803b-46ed-b133-d0278ef0eff6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:14.568967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929fbae-637f-4231-ac81-dd3d5963c410 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.572332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-4f90f2a9-803b-46ed-b133-d0278ef0eff6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:14.573551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 81/157] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:14.578649 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929fbae-637f-4231-ac81-dd3d5963c410 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.580178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90f2a9-803b-46ed-b133-d0278ef0eff6 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.589893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c67619-06b1-4a2a-93d2-19033542bd06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.590740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c67619-06b1-4a2a-93d2-19033542bd06 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.591026 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c67619-06b1-4a2a-93d2-19033542bd06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.591304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c67619-06b1-4a2a-93d2-19033542bd06 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.600509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f90f2a9-803b-46ed-b133-d0278ef0eff6 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.602945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c67619-06b1-4a2a-93d2-19033542bd06 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:14.611730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-b0c67619-06b1-4a2a-93d2-19033542bd06 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:14.612890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb552717-3e8b-4f4c-9f73-1231db8d13b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.613896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 77/158] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:14.614188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552717-3e8b-4f4c-9f73-1231db8d13b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.614469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552717-3e8b-4f4c-9f73-1231db8d13b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.614740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb552717-3e8b-4f4c-9f73-1231db8d13b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.615515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb552717-3e8b-4f4c-9f73-1231db8d13b2 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:14.615820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb552717-3e8b-4f4c-9f73-1231db8d13b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.617439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb552717-3e8b-4f4c-9f73-1231db8d13b2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.620779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c67619-06b1-4a2a-93d2-19033542bd06 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.627382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 82/159] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:14.633946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c67619-06b1-4a2a-93d2-19033542bd06 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.634193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb552717-3e8b-4f4c-9f73-1231db8d13b2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.638471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bdab2-a89a-449b-a10f-f4b7ee9f18b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.639269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bdab2-a89a-449b-a10f-f4b7ee9f18b7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.639490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bdab2-a89a-449b-a10f-f4b7ee9f18b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.639728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5bdab2-a89a-449b-a10f-f4b7ee9f18b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.640502 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bdab2-a89a-449b-a10f-f4b7ee9f18b7 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:14.640813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bdab2-a89a-449b-a10f-f4b7ee9f18b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.642518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5bdab2-a89a-449b-a10f-f4b7ee9f18b7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.648432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb552717-3e8b-4f4c-9f73-1231db8d13b2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.653326 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 78/160] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:14.660101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdda609-3dec-4570-b480-d4933034e992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.661349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda609-3dec-4570-b480-d4933034e992 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.661627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda609-3dec-4570-b480-d4933034e992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.661902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda609-3dec-4570-b480-d4933034e992 admin admin] PATH_INFO: `/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.665275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bdab2-a89a-449b-a10f-f4b7ee9f18b7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.680996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5bdab2-a89a-449b-a10f-f4b7ee9f18b7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.687379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77c603-eab2-44e0-98d2-401254c863ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.688250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77c603-eab2-44e0-98d2-401254c863ed admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.688531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77c603-eab2-44e0-98d2-401254c863ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.688807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77c603-eab2-44e0-98d2-401254c863ed admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.690279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77c603-eab2-44e0-98d2-401254c863ed admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.693472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77c603-eab2-44e0-98d2-401254c863ed admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.695299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 79/161] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:14.702984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77c603-eab2-44e0-98d2-401254c863ed admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.704965 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdda609-3dec-4570-b480-d4933034e992 admin admin] RBAC: Authorizing `identity:get_user(user_id=46a6e8f6c3d74cc788462f162cd3e2ce)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.707364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdda609-3dec-4570-b480-d4933034e992 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.709568 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 83/162] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce => generated 283 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:14.716142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdda609-3dec-4570-b480-d4933034e992 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.719023 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77c603-eab2-44e0-98d2-401254c863ed admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.727189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb5f5b-9d9d-4b42-8500-a2da542bcc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.727892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb5f5b-9d9d-4b42-8500-a2da542bcc6a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.728170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb5f5b-9d9d-4b42-8500-a2da542bcc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.728444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fb5f5b-9d9d-4b42-8500-a2da542bcc6a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.729389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdda609-3dec-4570-b480-d4933034e992 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.733798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9bc91-ad53-4f01-aa77-56fc066d5409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.734471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9bc91-ad53-4f01-aa77-56fc066d5409 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.734752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9bc91-ad53-4f01-aa77-56fc066d5409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.735025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf9bc91-ad53-4f01-aa77-56fc066d5409 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.744293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb5f5b-9d9d-4b42-8500-a2da542bcc6a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.746696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9bc91-ad53-4f01-aa77-56fc066d5409 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.747183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fb5f5b-9d9d-4b42-8500-a2da542bcc6a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.748634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf9bc91-ad53-4f01-aa77-56fc066d5409 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.759828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 84/163] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:00:14.763836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 80/164] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:14.767029 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9bc91-ad53-4f01-aa77-56fc066d5409 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.778377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb5f5b-9d9d-4b42-8500-a2da542bcc6a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.786180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf9bc91-ad53-4f01-aa77-56fc066d5409 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.790050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fb5f5b-9d9d-4b42-8500-a2da542bcc6a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.796752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114a1c-2f3d-4d85-bcd7-b74907738ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.797587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114a1c-2f3d-4d85-bcd7-b74907738ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.797868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114a1c-2f3d-4d85-bcd7-b74907738ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.798172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c114a1c-2f3d-4d85-bcd7-b74907738ba8 admin admin] PATH_INFO: `/v3/projects/b991dc97602e4f83a48dfb61d3218477` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.799866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114a1c-2f3d-4d85-bcd7-b74907738ba8 admin admin] RBAC: Authorizing `identity:get_project(project_id=b991dc97602e4f83a48dfb61d3218477)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.802770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c114a1c-2f3d-4d85-bcd7-b74907738ba8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.804511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 81/165] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/projects/b991dc97602e4f83a48dfb61d3218477 => generated 312 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:14.805078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96bc11-9ef3-4d01-89e3-b20a7384e7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.805930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96bc11-9ef3-4d01-89e3-b20a7384e7cf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.806229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96bc11-9ef3-4d01-89e3-b20a7384e7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.806502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96bc11-9ef3-4d01-89e3-b20a7384e7cf admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.812751 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96bc11-9ef3-4d01-89e3-b20a7384e7cf admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.814868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96bc11-9ef3-4d01-89e3-b20a7384e7cf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.817454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 85/166] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:14.818359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114a1c-2f3d-4d85-bcd7-b74907738ba8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.824449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96bc11-9ef3-4d01-89e3-b20a7384e7cf admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:14.836159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c114a1c-2f3d-4d85-bcd7-b74907738ba8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.838743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96bc11-9ef3-4d01-89e3-b20a7384e7cf admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:14.845867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777270b6-59a1-4a51-8cd7-afebcd2b39b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.846541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777270b6-59a1-4a51-8cd7-afebcd2b39b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.846821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777270b6-59a1-4a51-8cd7-afebcd2b39b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.847093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777270b6-59a1-4a51-8cd7-afebcd2b39b8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.847966 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777270b6-59a1-4a51-8cd7-afebcd2b39b8 admin admin] RBAC: Adding query filter params (role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=b991dc97602e4f83a48dfb61d3218477, user.id=73d3f947148f405db4b58b5f3f2f3c73) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:14.848272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777270b6-59a1-4a51-8cd7-afebcd2b39b8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.850132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777270b6-59a1-4a51-8cd7-afebcd2b39b8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.852431 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cea787-1f24-4cd4-a4f6-d9536935e2db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:14.853066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cea787-1f24-4cd4-a4f6-d9536935e2db admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:14.853344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cea787-1f24-4cd4-a4f6-d9536935e2db admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:14.853617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cea787-1f24-4cd4-a4f6-d9536935e2db admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:14.854478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cea787-1f24-4cd4-a4f6-d9536935e2db admin admin] RBAC: Adding query filter params (role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=a767e19648dd4ee78d2439f37a731774, user.id=46a6e8f6c3d74cc788462f162cd3e2ce) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:14.854785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cea787-1f24-4cd4-a4f6-d9536935e2db admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:14.856624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cea787-1f24-4cd4-a4f6-d9536935e2db admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:14.865399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 82/167] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/role_assignments?user.id=73d3f947148f405db4b58b5f3f2f3c73&scope.project.id=b991dc97602e4f83a48dfb61d3218477&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 608 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:14.871043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 86/168] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:14 2021] GET /identity/v3/role_assignments?user.id=46a6e8f6c3d74cc788462f162cd3e2ce&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 259 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:15.312268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632890b-ea3f-4171-aa7f-e9043055d9ec None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.312433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632890b-ea3f-4171-aa7f-e9043055d9ec None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.312704 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632890b-ea3f-4171-aa7f-e9043055d9ec None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.314510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 83/169] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:15.321378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc50ad-dfa1-4414-a853-d098c87ac282 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.321663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc50ad-dfa1-4414-a853-d098c87ac282 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.321941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbc50ad-dfa1-4414-a853-d098c87ac282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.345321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9fbc50ad-dfa1-4414-a853-d098c87ac282 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:15.346530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9fbc50ad-dfa1-4414-a853-d098c87ac282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:15.358348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 87/170] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:15.388021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632890b-ea3f-4171-aa7f-e9043055d9ec None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.400746 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632890b-ea3f-4171-aa7f-e9043055d9ec None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.405240 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029481e-ba3b-417b-afd9-4153d1aa0673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.406092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029481e-ba3b-417b-afd9-4153d1aa0673 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.406426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029481e-ba3b-417b-afd9-4153d1aa0673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.406705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029481e-ba3b-417b-afd9-4153d1aa0673 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.417606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5029481e-ba3b-417b-afd9-4153d1aa0673 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:15.424588 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-5029481e-ba3b-417b-afd9-4153d1aa0673 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:15.426545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 84/171] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/roles/admin => generated 83 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:15.433186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc50ad-dfa1-4414-a853-d098c87ac282 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.443392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbc50ad-dfa1-4414-a853-d098c87ac282 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.448001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735a4f-e233-4cc5-acf6-4423dddb3c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.448710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735a4f-e233-4cc5-acf6-4423dddb3c78 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.448990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735a4f-e233-4cc5-acf6-4423dddb3c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.449263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66735a4f-e233-4cc5-acf6-4423dddb3c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.450104 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735a4f-e233-4cc5-acf6-4423dddb3c78 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:15.450413 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735a4f-e233-4cc5-acf6-4423dddb3c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.452006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66735a4f-e233-4cc5-acf6-4423dddb3c78 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.464053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 88/172] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:15.469887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029481e-ba3b-417b-afd9-4153d1aa0673 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.480813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029481e-ba3b-417b-afd9-4153d1aa0673 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.485404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf523e-2fc2-4369-9205-410ca765e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.486386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf523e-2fc2-4369-9205-410ca765e5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.486674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf523e-2fc2-4369-9205-410ca765e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.486946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cf523e-2fc2-4369-9205-410ca765e5b0 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.488833 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf523e-2fc2-4369-9205-410ca765e5b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.490846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cf523e-2fc2-4369-9205-410ca765e5b0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.492586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 85/173] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:15.498866 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735a4f-e233-4cc5-acf6-4423dddb3c78 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.509705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66735a4f-e233-4cc5-acf6-4423dddb3c78 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.514389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3190ea9-9806-48cb-978f-596dd7b877bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.515025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3190ea9-9806-48cb-978f-596dd7b877bd admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.515308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3190ea9-9806-48cb-978f-596dd7b877bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.515636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3190ea9-9806-48cb-978f-596dd7b877bd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.524003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3190ea9-9806-48cb-978f-596dd7b877bd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.526122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3190ea9-9806-48cb-978f-596dd7b877bd admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.535747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 89/174] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:15.541823 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf523e-2fc2-4369-9205-410ca765e5b0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.552074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cf523e-2fc2-4369-9205-410ca765e5b0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.556740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a8096a-86c3-4616-9291-5011f75ec833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.557627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8096a-86c3-4616-9291-5011f75ec833 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.557911 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8096a-86c3-4616-9291-5011f75ec833 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.558227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a8096a-86c3-4616-9291-5011f75ec833 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.559559 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8096a-86c3-4616-9291-5011f75ec833 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.561856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a8096a-86c3-4616-9291-5011f75ec833 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.563810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 86/175] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:15.571283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3190ea9-9806-48cb-978f-596dd7b877bd admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.581565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3190ea9-9806-48cb-978f-596dd7b877bd admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.586762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69a150b-a1d5-410d-a206-510131cca598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.587546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a150b-a1d5-410d-a206-510131cca598 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.587879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a150b-a1d5-410d-a206-510131cca598 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.588157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69a150b-a1d5-410d-a206-510131cca598 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.589093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a150b-a1d5-410d-a206-510131cca598 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=a767e19648dd4ee78d2439f37a731774, user.id=5c3a6c2e10d54dfc8b895992ac771847) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:15.589467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a150b-a1d5-410d-a206-510131cca598 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.591547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69a150b-a1d5-410d-a206-510131cca598 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.598964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 90/176] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/role_assignments?user.id=5c3a6c2e10d54dfc8b895992ac771847&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:15.722265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f230d-6fdc-47fb-88f1-0336c17575e5 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.723803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f230d-6fdc-47fb-88f1-0336c17575e5 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.723803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48f230d-6fdc-47fb-88f1-0336c17575e5 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.725199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 87/177] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:15.731963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef831-36d0-4f75-b482-b60546ad553f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.732304 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef831-36d0-4f75-b482-b60546ad553f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.732509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72ef831-36d0-4f75-b482-b60546ad553f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.747836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aef95a-f20f-4c4e-a605-3d054c75f215 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.747836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aef95a-f20f-4c4e-a605-3d054c75f215 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.747836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aef95a-f20f-4c4e-a605-3d054c75f215 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.747836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 88/178] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:15.752605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c72ef831-36d0-4f75-b482-b60546ad553f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:15.755023 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c72ef831-36d0-4f75-b482-b60546ad553f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:15.757724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f9e86-26da-4da3-9f78-e2f6139f60c7 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.758233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f9e86-26da-4da3-9f78-e2f6139f60c7 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.758706 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8f9e86-26da-4da3-9f78-e2f6139f60c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.763063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 91/179] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:15.779629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-6b8f9e86-26da-4da3-9f78-e2f6139f60c7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:15.781185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6b8f9e86-26da-4da3-9f78-e2f6139f60c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:15.790173 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ef831-36d0-4f75-b482-b60546ad553f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.790643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 89/180] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:15 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:15.800153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72ef831-36d0-4f75-b482-b60546ad553f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.805370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e412ee-eb47-4031-aa0f-6aba7f1a5dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.806291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e412ee-eb47-4031-aa0f-6aba7f1a5dff admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.806650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e412ee-eb47-4031-aa0f-6aba7f1a5dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.806931 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e412ee-eb47-4031-aa0f-6aba7f1a5dff admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.819402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e412ee-eb47-4031-aa0f-6aba7f1a5dff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:15.820816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f9e86-26da-4da3-9f78-e2f6139f60c7 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.826841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-37e412ee-eb47-4031-aa0f-6aba7f1a5dff admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:15.828129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 92/181] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:15.831658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8f9e86-26da-4da3-9f78-e2f6139f60c7 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.835220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e412ee-eb47-4031-aa0f-6aba7f1a5dff admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.838103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c7574-918a-4901-bd57-4191071cf028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.839769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c7574-918a-4901-bd57-4191071cf028 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.840558 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c7574-918a-4901-bd57-4191071cf028 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.841101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5c7574-918a-4901-bd57-4191071cf028 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.842889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c7574-918a-4901-bd57-4191071cf028 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.844821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5c7574-918a-4901-bd57-4191071cf028 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.845743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e412ee-eb47-4031-aa0f-6aba7f1a5dff admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.847070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 90/182] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/domains/default => generated 199 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:15.854876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c7574-918a-4901-bd57-4191071cf028 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.859652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edd6f6-4cb4-4e32-bc1d-2bc96844f8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.860874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edd6f6-4cb4-4e32-bc1d-2bc96844f8c0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.861372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edd6f6-4cb4-4e32-bc1d-2bc96844f8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.862491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5edd6f6-4cb4-4e32-bc1d-2bc96844f8c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.864232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edd6f6-4cb4-4e32-bc1d-2bc96844f8c0 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:15.864753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edd6f6-4cb4-4e32-bc1d-2bc96844f8c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.865497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5c7574-918a-4901-bd57-4191071cf028 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.867032 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5edd6f6-4cb4-4e32-bc1d-2bc96844f8c0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.870795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e43e83-32b2-41df-9626-306d9175ba61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.871545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e43e83-32b2-41df-9626-306d9175ba61 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.871826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e43e83-32b2-41df-9626-306d9175ba61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.872102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e43e83-32b2-41df-9626-306d9175ba61 admin admin] PATH_INFO: `/v3/groups` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.872864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e43e83-32b2-41df-9626-306d9175ba61 admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.873960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-c3e43e83-32b2-41df-9626-306d9175ba61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:15.873960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:15.873960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:15.875664 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e43e83-32b2-41df-9626-306d9175ba61 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.879993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 93/183] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:15.887024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edd6f6-4cb4-4e32-bc1d-2bc96844f8c0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.897416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5edd6f6-4cb4-4e32-bc1d-2bc96844f8c0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.903321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a97cee-9e7d-4ca0-b9ad-3faf75fbde56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.903605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a97cee-9e7d-4ca0-b9ad-3faf75fbde56 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.903887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a97cee-9e7d-4ca0-b9ad-3faf75fbde56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.904157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a97cee-9e7d-4ca0-b9ad-3faf75fbde56 admin admin] PATH_INFO: `/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.905369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a97cee-9e7d-4ca0-b9ad-3faf75fbde56 admin admin] RBAC: Authorizing `identity:get_user(user_id=46a6e8f6c3d74cc788462f162cd3e2ce)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.907543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a97cee-9e7d-4ca0-b9ad-3faf75fbde56 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.909325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 94/184] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce => generated 283 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:15.915150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a97cee-9e7d-4ca0-b9ad-3faf75fbde56 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.924638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a97cee-9e7d-4ca0-b9ad-3faf75fbde56 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.929832 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208b1e-be6f-414d-a998-75ad1a081224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.930549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208b1e-be6f-414d-a998-75ad1a081224 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.930828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208b1e-be6f-414d-a998-75ad1a081224 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.931101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd208b1e-be6f-414d-a998-75ad1a081224 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.939104 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd208b1e-be6f-414d-a998-75ad1a081224 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:15.940855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd208b1e-be6f-414d-a998-75ad1a081224 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:15.954102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 91/185] 10.222.0.32 () {60 vars in 1155 bytes} [Wed Oct 27 01:00:15 2021] POST /identity/v3/groups => generated 229 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:00:15.961625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 95/186] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:00:15.967934 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e43e83-32b2-41df-9626-306d9175ba61 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:15.978948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e43e83-32b2-41df-9626-306d9175ba61 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:15.986302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba9bea7-b3eb-425f-836f-3806905f4030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:15.987257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9bea7-b3eb-425f-836f-3806905f4030 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:15.987542 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9bea7-b3eb-425f-836f-3806905f4030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:15.987902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba9bea7-b3eb-425f-836f-3806905f4030 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:15.995173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9bea7-b3eb-425f-836f-3806905f4030 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:16.000800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba9bea7-b3eb-425f-836f-3806905f4030 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:16.000800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 92/187] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:15 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:16.006807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208b1e-be6f-414d-a998-75ad1a081224 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:16.016396 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd208b1e-be6f-414d-a998-75ad1a081224 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:16.021854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf0e4e4-52dd-4097-8371-72d993a0e325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:16.022649 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0e4e4-52dd-4097-8371-72d993a0e325 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:16.022933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0e4e4-52dd-4097-8371-72d993a0e325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:16.023258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf0e4e4-52dd-4097-8371-72d993a0e325 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:16.024530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0e4e4-52dd-4097-8371-72d993a0e325 admin admin] RBAC: Adding query filter params (role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=a767e19648dd4ee78d2439f37a731774, user.id=46a6e8f6c3d74cc788462f162cd3e2ce) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:16.024930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0e4e4-52dd-4097-8371-72d993a0e325 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:16.026993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf0e4e4-52dd-4097-8371-72d993a0e325 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:16.033668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 96/188] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:16 2021] GET /identity/v3/role_assignments?user.id=46a6e8f6c3d74cc788462f162cd3e2ce&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:17.310172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9b500-98b1-48ed-bd03-949188c89ef4 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:17.310830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9b500-98b1-48ed-bd03-949188c89ef4 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:17.310830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd9b500-98b1-48ed-bd03-949188c89ef4 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:17.312525 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 93/189] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:17 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:17.321034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e828011-b7b1-4694-9c14-420429016911 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:17.321034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e828011-b7b1-4694-9c14-420429016911 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:17.321034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e828011-b7b1-4694-9c14-420429016911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:17.338355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8e828011-b7b1-4694-9c14-420429016911 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:17.339839 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8e828011-b7b1-4694-9c14-420429016911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:17.348100 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 97/190] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:17.371569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9b500-98b1-48ed-bd03-949188c89ef4 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:17.384074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd9b500-98b1-48ed-bd03-949188c89ef4 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:17.388653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385739a6-5145-4285-b979-11b07cd66747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:17.389653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385739a6-5145-4285-b979-11b07cd66747 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:17.390157 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385739a6-5145-4285-b979-11b07cd66747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:17.390620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385739a6-5145-4285-b979-11b07cd66747 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:17.401766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385739a6-5145-4285-b979-11b07cd66747 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:17.408855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-385739a6-5145-4285-b979-11b07cd66747 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:17.410921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 94/191] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:17 2021] GET /identity/v3/roles/member => generated 84 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:17.420061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e828011-b7b1-4694-9c14-420429016911 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:17.432635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e828011-b7b1-4694-9c14-420429016911 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:17.437135 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3af46-23e8-4fce-8afc-023a2a0d9afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:17.437830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3af46-23e8-4fce-8afc-023a2a0d9afa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:17.438140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3af46-23e8-4fce-8afc-023a2a0d9afa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:17.438415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3af46-23e8-4fce-8afc-023a2a0d9afa admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:17.439382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3af46-23e8-4fce-8afc-023a2a0d9afa admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:17.439690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3af46-23e8-4fce-8afc-023a2a0d9afa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:17.443184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3af46-23e8-4fce-8afc-023a2a0d9afa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:17.452464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 98/192] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:17 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:17.458914 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385739a6-5145-4285-b979-11b07cd66747 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:17.469569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385739a6-5145-4285-b979-11b07cd66747 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:17.474612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499fee-1e3a-4cd5-9fc8-07e0119f58c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:17.475457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499fee-1e3a-4cd5-9fc8-07e0119f58c3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:17.475734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499fee-1e3a-4cd5-9fc8-07e0119f58c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:17.476004 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee499fee-1e3a-4cd5-9fc8-07e0119f58c3 admin admin] PATH_INFO: `/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:17.477241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499fee-1e3a-4cd5-9fc8-07e0119f58c3 admin admin] RBAC: Authorizing `identity:get_user(user_id=46a6e8f6c3d74cc788462f162cd3e2ce)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:17.479391 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee499fee-1e3a-4cd5-9fc8-07e0119f58c3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:17.481270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 95/193] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:17 2021] GET /identity/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce => generated 283 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:17.487545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3af46-23e8-4fce-8afc-023a2a0d9afa admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:17.498223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3af46-23e8-4fce-8afc-023a2a0d9afa admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:17.502556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f02bc-6754-47b8-b295-af058b01feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:17.503391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f02bc-6754-47b8-b295-af058b01feb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:17.503974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f02bc-6754-47b8-b295-af058b01feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:17.504243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f02bc-6754-47b8-b295-af058b01feb6 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:17.505432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f02bc-6754-47b8-b295-af058b01feb6 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:17.507539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f02bc-6754-47b8-b295-af058b01feb6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:17.509189 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 99/194] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:17 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:17.515748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499fee-1e3a-4cd5-9fc8-07e0119f58c3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:17.527090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee499fee-1e3a-4cd5-9fc8-07e0119f58c3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:17.531577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3883261-f2b9-4df3-aea0-7448e46f85b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:17.532450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883261-f2b9-4df3-aea0-7448e46f85b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:17.532728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883261-f2b9-4df3-aea0-7448e46f85b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:17.533000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3883261-f2b9-4df3-aea0-7448e46f85b4 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774/users/46a6e8f6c3d74cc788462f162cd3e2ce/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:17.535565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883261-f2b9-4df3-aea0-7448e46f85b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767e19648dd4ee78d2439f37a731774, user_id=46a6e8f6c3d74cc788462f162cd3e2ce, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:17.538202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3883261-f2b9-4df3-aea0-7448e46f85b4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:17.618330 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 96/195] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:17 2021] PUT /identity/v3/projects/a767e19648dd4ee78d2439f37a731774/users/46a6e8f6c3d74cc788462f162cd3e2ce/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:17.944618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101de14-716b-4848-8e94-ab046db2d7aa None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:17.944991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101de14-716b-4848-8e94-ab046db2d7aa None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:17.945165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101de14-716b-4848-8e94-ab046db2d7aa None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:17.947054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 100/196] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:17.953237 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ec3b9-7172-4944-b9e7-28074607b574 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:17.953530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ec3b9-7172-4944-b9e7-28074607b574 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:17.953838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65ec3b9-7172-4944-b9e7-28074607b574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:17.973084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-a65ec3b9-7172-4944-b9e7-28074607b574 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:17.974777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a65ec3b9-7172-4944-b9e7-28074607b574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:18.035520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 97/197] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:17 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:18.060975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101de14-716b-4848-8e94-ab046db2d7aa None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.077575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101de14-716b-4848-8e94-ab046db2d7aa None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.082710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22464c-81b7-4afc-9880-11c0ef970667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.083771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22464c-81b7-4afc-9880-11c0ef970667 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.084231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22464c-81b7-4afc-9880-11c0ef970667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.084691 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22464c-81b7-4afc-9880-11c0ef970667 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.095652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22464c-81b7-4afc-9880-11c0ef970667 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:18.103801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-2d22464c-81b7-4afc-9880-11c0ef970667 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:18.109028 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 101/198] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:18 2021] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:18.112273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ec3b9-7172-4944-b9e7-28074607b574 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.122656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65ec3b9-7172-4944-b9e7-28074607b574 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.127405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bfbfd-02a8-48bc-b9dd-5dcba4dfd95c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.128256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bfbfd-02a8-48bc-b9dd-5dcba4dfd95c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.128884 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bfbfd-02a8-48bc-b9dd-5dcba4dfd95c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.129507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bfbfd-02a8-48bc-b9dd-5dcba4dfd95c admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.130558 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bfbfd-02a8-48bc-b9dd-5dcba4dfd95c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:18.131040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bfbfd-02a8-48bc-b9dd-5dcba4dfd95c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.132872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bfbfd-02a8-48bc-b9dd-5dcba4dfd95c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.149457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 98/199] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:18 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:18.151121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22464c-81b7-4afc-9880-11c0ef970667 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.163015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22464c-81b7-4afc-9880-11c0ef970667 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.168058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239d0b2-4384-4c37-b270-a4e32896e4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.169152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239d0b2-4384-4c37-b270-a4e32896e4f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.169682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239d0b2-4384-4c37-b270-a4e32896e4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.170158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0239d0b2-4384-4c37-b270-a4e32896e4f0 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.171569 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239d0b2-4384-4c37-b270-a4e32896e4f0 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.173594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0239d0b2-4384-4c37-b270-a4e32896e4f0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.176632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 102/200] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:18 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:18.182251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bfbfd-02a8-48bc-b9dd-5dcba4dfd95c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.193204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bfbfd-02a8-48bc-b9dd-5dcba4dfd95c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.198063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8edef7-fccf-4cff-99c5-11895c6c5787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.199152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edef7-fccf-4cff-99c5-11895c6c5787 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.199613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edef7-fccf-4cff-99c5-11895c6c5787 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.200080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8edef7-fccf-4cff-99c5-11895c6c5787 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.201474 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8edef7-fccf-4cff-99c5-11895c6c5787 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.203855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8edef7-fccf-4cff-99c5-11895c6c5787 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.205779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 99/201] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:18 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:18.212820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239d0b2-4384-4c37-b270-a4e32896e4f0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.223538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0239d0b2-4384-4c37-b270-a4e32896e4f0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.228196 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9062f6e-180c-495b-863c-19ab48ac09f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.229126 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9062f6e-180c-495b-863c-19ab48ac09f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.229407 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9062f6e-180c-495b-863c-19ab48ac09f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.229682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9062f6e-180c-495b-863c-19ab48ac09f6 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774/users/5c3a6c2e10d54dfc8b895992ac771847/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.231944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9062f6e-180c-495b-863c-19ab48ac09f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767e19648dd4ee78d2439f37a731774, user_id=5c3a6c2e10d54dfc8b895992ac771847, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.234788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9062f6e-180c-495b-863c-19ab48ac09f6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.320810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 103/202] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:18 2021] PUT /identity/v3/projects/a767e19648dd4ee78d2439f37a731774/users/5c3a6c2e10d54dfc8b895992ac771847/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:18.368080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4715-a80a-4132-82cc-c6abb9a4645c None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.368585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4715-a80a-4132-82cc-c6abb9a4645c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.368693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddda4715-a80a-4132-82cc-c6abb9a4645c None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.370623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 100/203] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:18.377228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dd553-2303-401f-8473-902747f24da2 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.377739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dd553-2303-401f-8473-902747f24da2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.378010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2dd553-2303-401f-8473-902747f24da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.382998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561157f8-f0e3-4578-a5e1-159472657a63 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.383277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561157f8-f0e3-4578-a5e1-159472657a63 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.383542 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561157f8-f0e3-4578-a5e1-159472657a63 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.385376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 101/204] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:18.392016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927639a-c45e-4c78-8c88-1336b2c112aa None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.392384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927639a-c45e-4c78-8c88-1336b2c112aa None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.392594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927639a-c45e-4c78-8c88-1336b2c112aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.399619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-2c2dd553-2303-401f-8473-902747f24da2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:18.401151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2c2dd553-2303-401f-8473-902747f24da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:18.414099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8927639a-c45e-4c78-8c88-1336b2c112aa None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:18.415966 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8927639a-c45e-4c78-8c88-1336b2c112aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:18.467803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 104/205] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:18.490182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 102/206] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:18 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:18.494155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dd553-2303-401f-8473-902747f24da2 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.502019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2dd553-2303-401f-8473-902747f24da2 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.507784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c80d95-9cba-4baf-a1a3-322da406f3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.508728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c80d95-9cba-4baf-a1a3-322da406f3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.509071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c80d95-9cba-4baf-a1a3-322da406f3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.509413 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c80d95-9cba-4baf-a1a3-322da406f3e3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.520138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927639a-c45e-4c78-8c88-1336b2c112aa None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.521411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c80d95-9cba-4baf-a1a3-322da406f3e3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:18.529293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-03c80d95-9cba-4baf-a1a3-322da406f3e3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:18.531010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 105/207] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:18 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:18.531455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927639a-c45e-4c78-8c88-1336b2c112aa None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.538101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c80d95-9cba-4baf-a1a3-322da406f3e3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.539538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf71d50-62ee-4862-bf60-39bcf87c8590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.541214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf71d50-62ee-4862-bf60-39bcf87c8590 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.541495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf71d50-62ee-4862-bf60-39bcf87c8590 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.541768 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf71d50-62ee-4862-bf60-39bcf87c8590 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.543540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf71d50-62ee-4862-bf60-39bcf87c8590 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.545241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf71d50-62ee-4862-bf60-39bcf87c8590 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.546912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 103/208] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:18 2021] GET /identity/v3/domains/default => generated 199 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:18.551180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c80d95-9cba-4baf-a1a3-322da406f3e3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.554084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf71d50-62ee-4862-bf60-39bcf87c8590 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.557553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b643-9e7f-4e14-abb4-f3cc2ae4b83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.558309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b643-9e7f-4e14-abb4-f3cc2ae4b83a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.558583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b643-9e7f-4e14-abb4-f3cc2ae4b83a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.558849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e3b643-9e7f-4e14-abb4-f3cc2ae4b83a admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.559613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3b643-9e7f-4e14-abb4-f3cc2ae4b83a admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:18.559909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3b643-9e7f-4e14-abb4-f3cc2ae4b83a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.561511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e3b643-9e7f-4e14-abb4-f3cc2ae4b83a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.565554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf71d50-62ee-4862-bf60-39bcf87c8590 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.572950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17649fca-9014-4c61-a7e5-25aa39e6013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.573633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17649fca-9014-4c61-a7e5-25aa39e6013c admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.573912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17649fca-9014-4c61-a7e5-25aa39e6013c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.574246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17649fca-9014-4c61-a7e5-25aa39e6013c admin admin] PATH_INFO: `/v3/groups` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.575008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 106/209] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:18 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:18.575121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17649fca-9014-4c61-a7e5-25aa39e6013c admin admin] RBAC: Authorizing `identity:create_group()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.577853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17649fca-9014-4c61-a7e5-25aa39e6013c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.581967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b643-9e7f-4e14-abb4-f3cc2ae4b83a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.599047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e3b643-9e7f-4e14-abb4-f3cc2ae4b83a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.603628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1f0a8-441e-4862-a871-78f8e3826209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.604499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1f0a8-441e-4862-a871-78f8e3826209 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.604781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1f0a8-441e-4862-a871-78f8e3826209 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.605102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1f0a8-441e-4862-a871-78f8e3826209 admin admin] PATH_INFO: `/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.606345 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1f0a8-441e-4862-a871-78f8e3826209 admin admin] RBAC: Authorizing `identity:get_user(user_id=46a6e8f6c3d74cc788462f162cd3e2ce)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.608443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1f0a8-441e-4862-a871-78f8e3826209 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.610263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 107/210] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:18 2021] GET /identity/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce => generated 283 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:18.616676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1f0a8-441e-4862-a871-78f8e3826209 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.626132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1f0a8-441e-4862-a871-78f8e3826209 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.631097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd33cc7-b395-431b-83f8-ba885ef6fcf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.631928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd33cc7-b395-431b-83f8-ba885ef6fcf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.632210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd33cc7-b395-431b-83f8-ba885ef6fcf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.632485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd33cc7-b395-431b-83f8-ba885ef6fcf8 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.633667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd33cc7-b395-431b-83f8-ba885ef6fcf8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.635719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd33cc7-b395-431b-83f8-ba885ef6fcf8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.637453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 108/211] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:18 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:18.643408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd33cc7-b395-431b-83f8-ba885ef6fcf8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:18.653282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd33cc7-b395-431b-83f8-ba885ef6fcf8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:18.657608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3dd874-d7ba-4e35-be38-5799a9cc4870 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:18.658509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dd874-d7ba-4e35-be38-5799a9cc4870 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:18.658770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dd874-d7ba-4e35-be38-5799a9cc4870 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:18.659042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3dd874-d7ba-4e35-be38-5799a9cc4870 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774/users/46a6e8f6c3d74cc788462f162cd3e2ce/roles/3e47746460b74dbb90c678ac5b65a01a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:18.661923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dd874-d7ba-4e35-be38-5799a9cc4870 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767e19648dd4ee78d2439f37a731774, user_id=46a6e8f6c3d74cc788462f162cd3e2ce, role_id=3e47746460b74dbb90c678ac5b65a01a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:18.664543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3dd874-d7ba-4e35-be38-5799a9cc4870 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:18.697740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 104/212] 10.222.0.32 () {60 vars in 1155 bytes} [Wed Oct 27 01:00:18 2021] POST /identity/v3/groups => generated 226 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:00:18.810161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 109/213] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:18 2021] PUT /identity/v3/projects/a767e19648dd4ee78d2439f37a731774/users/46a6e8f6c3d74cc788462f162cd3e2ce/roles/3e47746460b74dbb90c678ac5b65a01a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:00:20.232800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26fabb-e355-4249-b5fe-1fd39ccf064f None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:20.233653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26fabb-e355-4249-b5fe-1fd39ccf064f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:20.234106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26fabb-e355-4249-b5fe-1fd39ccf064f None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:20.236049 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 105/214] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:20.242942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fdc1d-e176-43ff-8a78-eeaedb3a08ee None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:20.243802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fdc1d-e176-43ff-8a78-eeaedb3a08ee None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:20.244306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16fdc1d-e176-43ff-8a78-eeaedb3a08ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:20.390302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b16fdc1d-e176-43ff-8a78-eeaedb3a08ee None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:20.391819 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b16fdc1d-e176-43ff-8a78-eeaedb3a08ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:20.462138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 110/215] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:20 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:20.492496 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26fabb-e355-4249-b5fe-1fd39ccf064f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:20.505777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26fabb-e355-4249-b5fe-1fd39ccf064f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:20.513636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da997342-2ea3-4eee-a1fe-8d3b594803f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:20.514744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da997342-2ea3-4eee-a1fe-8d3b594803f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:20.515190 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da997342-2ea3-4eee-a1fe-8d3b594803f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:20.516238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da997342-2ea3-4eee-a1fe-8d3b594803f7 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:20.532442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da997342-2ea3-4eee-a1fe-8d3b594803f7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:20.539793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-da997342-2ea3-4eee-a1fe-8d3b594803f7 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:20.541209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 106/216] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:20 2021] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:20.547916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fdc1d-e176-43ff-8a78-eeaedb3a08ee None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:20.557971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16fdc1d-e176-43ff-8a78-eeaedb3a08ee None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:20.566685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea645e7-b62e-46ef-bb7b-d529c2912c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:20.567827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea645e7-b62e-46ef-bb7b-d529c2912c4b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:20.568310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea645e7-b62e-46ef-bb7b-d529c2912c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:20.568758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea645e7-b62e-46ef-bb7b-d529c2912c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:20.569750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea645e7-b62e-46ef-bb7b-d529c2912c4b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:20.570253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea645e7-b62e-46ef-bb7b-d529c2912c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:20.572027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea645e7-b62e-46ef-bb7b-d529c2912c4b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:20.581223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 111/217] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:20 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:20.587709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da997342-2ea3-4eee-a1fe-8d3b594803f7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:20.598422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da997342-2ea3-4eee-a1fe-8d3b594803f7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:20.603292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1411b-2864-4694-ae14-20b9e907a15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:20.604352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1411b-2864-4694-ae14-20b9e907a15f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:20.604808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1411b-2864-4694-ae14-20b9e907a15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:20.605254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a1411b-2864-4694-ae14-20b9e907a15f admin admin] PATH_INFO: `/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:20.610751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1411b-2864-4694-ae14-20b9e907a15f admin admin] RBAC: Authorizing `identity:get_user(user_id=46a6e8f6c3d74cc788462f162cd3e2ce)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:20.613701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a1411b-2864-4694-ae14-20b9e907a15f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:20.615629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 107/218] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:20 2021] GET /identity/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce => generated 283 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:20.623325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea645e7-b62e-46ef-bb7b-d529c2912c4b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:20.634098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea645e7-b62e-46ef-bb7b-d529c2912c4b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:20.642059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f5342-1f3d-4b31-a0fa-ac45c0013eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:20.643031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f5342-1f3d-4b31-a0fa-ac45c0013eef admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:20.643493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f5342-1f3d-4b31-a0fa-ac45c0013eef admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:20.643969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8f5342-1f3d-4b31-a0fa-ac45c0013eef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:20.653165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f5342-1f3d-4b31-a0fa-ac45c0013eef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:20.655222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8f5342-1f3d-4b31-a0fa-ac45c0013eef admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:20.671899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 112/219] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:20 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:20.680025 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1411b-2864-4694-ae14-20b9e907a15f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:20.695635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a1411b-2864-4694-ae14-20b9e907a15f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:20.700434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa735d39-87f6-4378-b72a-2777722601da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:20.701513 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa735d39-87f6-4378-b72a-2777722601da admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:20.701971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa735d39-87f6-4378-b72a-2777722601da admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:20.702453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa735d39-87f6-4378-b72a-2777722601da admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:20.706809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa735d39-87f6-4378-b72a-2777722601da admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:20.709052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa735d39-87f6-4378-b72a-2777722601da admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:20.711001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 108/220] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:20 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:20.718348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f5342-1f3d-4b31-a0fa-ac45c0013eef admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:20.729198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8f5342-1f3d-4b31-a0fa-ac45c0013eef admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:20.734141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b21df2-7739-4913-982a-bdf5926e78d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:20.735086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b21df2-7739-4913-982a-bdf5926e78d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:20.735573 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b21df2-7739-4913-982a-bdf5926e78d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:20.736025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b21df2-7739-4913-982a-bdf5926e78d3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:20.737066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b21df2-7739-4913-982a-bdf5926e78d3 admin admin] RBAC: Adding query filter params (role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=a767e19648dd4ee78d2439f37a731774, user.id=46a6e8f6c3d74cc788462f162cd3e2ce) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:20.737561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b21df2-7739-4913-982a-bdf5926e78d3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:20.740567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b21df2-7739-4913-982a-bdf5926e78d3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:20.747799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 113/221] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:20 2021] GET /identity/v3/role_assignments?user.id=46a6e8f6c3d74cc788462f162cd3e2ce&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:21.053779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf194-4b9c-43d2-81b9-535b4f8bbf20 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:21.054396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf194-4b9c-43d2-81b9-535b4f8bbf20 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:21.054850 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ebf194-4b9c-43d2-81b9-535b4f8bbf20 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:21.056909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 109/222] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:21.072294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31ab30-97e2-494e-a3a7-e4ab2df5b6f3 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:21.072861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31ab30-97e2-494e-a3a7-e4ab2df5b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:21.073314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e31ab30-97e2-494e-a3a7-e4ab2df5b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:21.092901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-2e31ab30-97e2-494e-a3a7-e4ab2df5b6f3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:21.098521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2e31ab30-97e2-494e-a3a7-e4ab2df5b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:21.106623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 114/223] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:21 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:21.143871 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebf194-4b9c-43d2-81b9-535b4f8bbf20 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:21.160695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ebf194-4b9c-43d2-81b9-535b4f8bbf20 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:21.168621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46588-b590-444e-bfd2-569300e4298c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:21.169737 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46588-b590-444e-bfd2-569300e4298c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:21.170227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46588-b590-444e-bfd2-569300e4298c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:21.170679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac46588-b590-444e-bfd2-569300e4298c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:21.188711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac46588-b590-444e-bfd2-569300e4298c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:21.196277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-dac46588-b590-444e-bfd2-569300e4298c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:21.197730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 110/224] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:21 2021] GET /identity/v3/roles/admin => generated 83 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:21.204260 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31ab30-97e2-494e-a3a7-e4ab2df5b6f3 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:21.213890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e31ab30-97e2-494e-a3a7-e4ab2df5b6f3 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:21.222598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832028-913a-4af2-ad6f-fbdb03d9faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:21.223510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832028-913a-4af2-ad6f-fbdb03d9faab admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:21.223992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832028-913a-4af2-ad6f-fbdb03d9faab admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:21.224450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2832028-913a-4af2-ad6f-fbdb03d9faab admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:21.225397 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2832028-913a-4af2-ad6f-fbdb03d9faab admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:21.225875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2832028-913a-4af2-ad6f-fbdb03d9faab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:21.227665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2832028-913a-4af2-ad6f-fbdb03d9faab admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:21.236797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 115/225] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:21 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:21.243673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46588-b590-444e-bfd2-569300e4298c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:21.254542 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac46588-b590-444e-bfd2-569300e4298c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:21.265358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3113fa-f454-4c33-a10b-4811c13368f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:21.266611 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3113fa-f454-4c33-a10b-4811c13368f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:21.267158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3113fa-f454-4c33-a10b-4811c13368f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:21.267606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3113fa-f454-4c33-a10b-4811c13368f3 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:21.269866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3113fa-f454-4c33-a10b-4811c13368f3 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:21.271984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3113fa-f454-4c33-a10b-4811c13368f3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:21.274262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 111/226] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:21 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:21.280687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832028-913a-4af2-ad6f-fbdb03d9faab admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:21.292419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2832028-913a-4af2-ad6f-fbdb03d9faab admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:21.301440 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b972f32-834c-4367-b75c-6d2da3bc2789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:21.302389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b972f32-834c-4367-b75c-6d2da3bc2789 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:21.302878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b972f32-834c-4367-b75c-6d2da3bc2789 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:21.303330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b972f32-834c-4367-b75c-6d2da3bc2789 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:21.312222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b972f32-834c-4367-b75c-6d2da3bc2789 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:21.314230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b972f32-834c-4367-b75c-6d2da3bc2789 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:21.328420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 116/227] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:21 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:21.335439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3113fa-f454-4c33-a10b-4811c13368f3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:21.346648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3113fa-f454-4c33-a10b-4811c13368f3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:21.357787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257aadfc-5dff-4be0-93b6-8f2440c48d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:21.358941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aadfc-5dff-4be0-93b6-8f2440c48d11 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:21.359402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aadfc-5dff-4be0-93b6-8f2440c48d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:21.359875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257aadfc-5dff-4be0-93b6-8f2440c48d11 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:21.361261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257aadfc-5dff-4be0-93b6-8f2440c48d11 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:21.363904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257aadfc-5dff-4be0-93b6-8f2440c48d11 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:21.366080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 112/228] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:21 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:21.372693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b972f32-834c-4367-b75c-6d2da3bc2789 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:21.382380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b972f32-834c-4367-b75c-6d2da3bc2789 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:21.389375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebef1e1-c061-4292-853e-132ae03ab24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:21.390053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebef1e1-c061-4292-853e-132ae03ab24f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:21.390329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebef1e1-c061-4292-853e-132ae03ab24f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:21.390604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebef1e1-c061-4292-853e-132ae03ab24f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:21.391449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebef1e1-c061-4292-853e-132ae03ab24f admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=a767e19648dd4ee78d2439f37a731774, user.id=5c3a6c2e10d54dfc8b895992ac771847) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:21.391757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebef1e1-c061-4292-853e-132ae03ab24f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:21.393583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebef1e1-c061-4292-853e-132ae03ab24f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:21.407359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 117/229] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:21 2021] GET /identity/v3/role_assignments?user.id=5c3a6c2e10d54dfc8b895992ac771847&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 608 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:22.111080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1c416-f946-4da4-8874-9a7c76967845 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.111707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1c416-f946-4da4-8874-9a7c76967845 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.112193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1c416-f946-4da4-8874-9a7c76967845 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.114749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 113/230] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:22 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:22.129367 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383e29a-509e-48da-9cad-59e1d1df0f1e None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.129714 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383e29a-509e-48da-9cad-59e1d1df0f1e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.129957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383e29a-509e-48da-9cad-59e1d1df0f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.154445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-1383e29a-509e-48da-9cad-59e1d1df0f1e None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:22.155645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1383e29a-509e-48da-9cad-59e1d1df0f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:22.172060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 118/231] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:22.209946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1c416-f946-4da4-8874-9a7c76967845 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.227352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1c416-f946-4da4-8874-9a7c76967845 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.237588 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3bca0-b998-42de-b0f2-e26e3c26533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.239281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3bca0-b998-42de-b0f2-e26e3c26533c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.239750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3bca0-b998-42de-b0f2-e26e3c26533c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.240227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a3bca0-b998-42de-b0f2-e26e3c26533c admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.257488 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a3bca0-b998-42de-b0f2-e26e3c26533c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:22.265038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-61a3bca0-b998-42de-b0f2-e26e3c26533c admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:22.266487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 114/232] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/roles/member => generated 84 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:22.273100 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383e29a-509e-48da-9cad-59e1d1df0f1e None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.286678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1383e29a-509e-48da-9cad-59e1d1df0f1e None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.297270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a06fb1-4e78-4848-8bd5-400dbdd441e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.297942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06fb1-4e78-4848-8bd5-400dbdd441e1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.298239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06fb1-4e78-4848-8bd5-400dbdd441e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.298506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a06fb1-4e78-4848-8bd5-400dbdd441e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.299273 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a06fb1-4e78-4848-8bd5-400dbdd441e1 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:22.299570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a06fb1-4e78-4848-8bd5-400dbdd441e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.301705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a06fb1-4e78-4848-8bd5-400dbdd441e1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.316894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 119/233] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:22.324075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3bca0-b998-42de-b0f2-e26e3c26533c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.337465 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a3bca0-b998-42de-b0f2-e26e3c26533c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.345544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbf209-e017-40b5-9e1e-17899df9a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.346525 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf209-e017-40b5-9e1e-17899df9a409 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.347031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf209-e017-40b5-9e1e-17899df9a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.347494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bbf209-e017-40b5-9e1e-17899df9a409 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.356977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4671a37-c3f0-4940-b0b9-e26599dc517b None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.357271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4671a37-c3f0-4940-b0b9-e26599dc517b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.357539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4671a37-c3f0-4940-b0b9-e26599dc517b None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.359377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 120/234] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:22.359932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbf209-e017-40b5-9e1e-17899df9a409 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.361688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bbf209-e017-40b5-9e1e-17899df9a409 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.370935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaefab-4863-4990-a7a2-e2b17e8794f3 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.371245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaefab-4863-4990-a7a2-e2b17e8794f3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.371466 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deaefab-4863-4990-a7a2-e2b17e8794f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.377861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 115/235] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:22.384643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbf209-e017-40b5-9e1e-17899df9a409 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.393631 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bbf209-e017-40b5-9e1e-17899df9a409 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.403666 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a83c1-59b6-4b16-8bab-bb7347e04194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.404591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a83c1-59b6-4b16-8bab-bb7347e04194 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.404865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a83c1-59b6-4b16-8bab-bb7347e04194 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.405145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936a83c1-59b6-4b16-8bab-bb7347e04194 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.406454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a83c1-59b6-4b16-8bab-bb7347e04194 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.408281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-1deaefab-4863-4990-a7a2-e2b17e8794f3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:22.408615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936a83c1-59b6-4b16-8bab-bb7347e04194 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.409454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1deaefab-4863-4990-a7a2-e2b17e8794f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:22.411198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 116/236] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:22.417392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a83c1-59b6-4b16-8bab-bb7347e04194 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.422229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 121/237] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 27 01:00:22.428898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936a83c1-59b6-4b16-8bab-bb7347e04194 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.438067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca930541-42ed-46ef-bc66-5b2594467ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.438899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930541-42ed-46ef-bc66-5b2594467ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.439183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930541-42ed-46ef-bc66-5b2594467ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.439449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca930541-42ed-46ef-bc66-5b2594467ec1 admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.447237 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca930541-42ed-46ef-bc66-5b2594467ec1 admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.448263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-ca930541-42ed-46ef-bc66-5b2594467ec1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:22.448263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:22.448263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:22.450262 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaefab-4863-4990-a7a2-e2b17e8794f3 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.455277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca930541-42ed-46ef-bc66-5b2594467ec1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.459967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 117/238] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:22.461839 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deaefab-4863-4990-a7a2-e2b17e8794f3 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.464356 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca930541-42ed-46ef-bc66-5b2594467ec1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.466546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097aab-4fee-4eed-86fe-bc8fbc68e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.467355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097aab-4fee-4eed-86fe-bc8fbc68e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.467674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097aab-4fee-4eed-86fe-bc8fbc68e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.468000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77097aab-4fee-4eed-86fe-bc8fbc68e1a8 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.475906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca930541-42ed-46ef-bc66-5b2594467ec1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.479863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77097aab-4fee-4eed-86fe-bc8fbc68e1a8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:22.482811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a808-4d2d-48f7-8082-ccda9d85c081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.483465 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a808-4d2d-48f7-8082-ccda9d85c081 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.483743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a808-4d2d-48f7-8082-ccda9d85c081 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.484019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a808-4d2d-48f7-8082-ccda9d85c081 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.484866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a808-4d2d-48f7-8082-ccda9d85c081 admin admin] RBAC: Adding query filter params (group.id=110829c5a82e484cb2a67ff51f067241, role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:22.485170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a808-4d2d-48f7-8082-ccda9d85c081 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.487118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a808-4d2d-48f7-8082-ccda9d85c081 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.487835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-77097aab-4fee-4eed-86fe-bc8fbc68e1a8 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:22.489284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 122/239] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:22.495675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097aab-4fee-4eed-86fe-bc8fbc68e1a8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.496870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 118/240] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/role_assignments?group.id=110829c5a82e484cb2a67ff51f067241&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:22.512872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77097aab-4fee-4eed-86fe-bc8fbc68e1a8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.520723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4ad60-98f3-444a-a5f6-052724ad2dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.521451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4ad60-98f3-444a-a5f6-052724ad2dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.521724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4ad60-98f3-444a-a5f6-052724ad2dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.522057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a4ad60-98f3-444a-a5f6-052724ad2dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.522851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4ad60-98f3-444a-a5f6-052724ad2dc8 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:22.523153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4ad60-98f3-444a-a5f6-052724ad2dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.525205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a4ad60-98f3-444a-a5f6-052724ad2dc8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.548913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 123/241] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:22.556204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a808-4d2d-48f7-8082-ccda9d85c081 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.575886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a808-4d2d-48f7-8082-ccda9d85c081 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.591898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9b515-df7d-460b-ae44-a00230e072cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.592797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9b515-df7d-460b-ae44-a00230e072cd admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.593074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9b515-df7d-460b-ae44-a00230e072cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.593341 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9b515-df7d-460b-ae44-a00230e072cd admin admin] PATH_INFO: `/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.594626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9b515-df7d-460b-ae44-a00230e072cd admin admin] RBAC: Authorizing `identity:get_user(user_id=46a6e8f6c3d74cc788462f162cd3e2ce)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.596799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c9b515-df7d-460b-ae44-a00230e072cd admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.603774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 119/242] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce => generated 283 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:22.609798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4ad60-98f3-444a-a5f6-052724ad2dc8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.632806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a4ad60-98f3-444a-a5f6-052724ad2dc8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.642452 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d763c-8aa9-4c42-9760-f7702d173748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.643124 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d763c-8aa9-4c42-9760-f7702d173748 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.643404 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d763c-8aa9-4c42-9760-f7702d173748 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.643680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d763c-8aa9-4c42-9760-f7702d173748 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.661283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d763c-8aa9-4c42-9760-f7702d173748 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.663140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d763c-8aa9-4c42-9760-f7702d173748 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.680754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 124/243] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:22.687253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9b515-df7d-460b-ae44-a00230e072cd admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.701483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c9b515-df7d-460b-ae44-a00230e072cd admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.712480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91233546-561c-491d-b7e5-10b576ba7026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.713405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91233546-561c-491d-b7e5-10b576ba7026 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.713688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91233546-561c-491d-b7e5-10b576ba7026 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.713962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91233546-561c-491d-b7e5-10b576ba7026 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.715249 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91233546-561c-491d-b7e5-10b576ba7026 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.717279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91233546-561c-491d-b7e5-10b576ba7026 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.719283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 120/244] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:22.725767 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d763c-8aa9-4c42-9760-f7702d173748 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.741274 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d763c-8aa9-4c42-9760-f7702d173748 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.751002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7db187-0d30-4c0d-85c5-1051060cf5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.751668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db187-0d30-4c0d-85c5-1051060cf5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.751949 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db187-0d30-4c0d-85c5-1051060cf5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.752219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7db187-0d30-4c0d-85c5-1051060cf5a9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.753066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7db187-0d30-4c0d-85c5-1051060cf5a9 admin admin] RBAC: Adding query filter params (role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=a767e19648dd4ee78d2439f37a731774, user.id=46a6e8f6c3d74cc788462f162cd3e2ce) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:22.753889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7db187-0d30-4c0d-85c5-1051060cf5a9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:22.755829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7db187-0d30-4c0d-85c5-1051060cf5a9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:22.767097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 125/245] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/role_assignments?user.id=46a6e8f6c3d74cc788462f162cd3e2ce&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 608 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:22.852679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e88b26-7668-438a-9df5-50a3df801a0c None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.852999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e88b26-7668-438a-9df5-50a3df801a0c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.853221 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e88b26-7668-438a-9df5-50a3df801a0c None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.855136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 121/246] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:22.861389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeacd9-b418-4a77-8ef0-241afd5608c3 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.861675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeacd9-b418-4a77-8ef0-241afd5608c3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.861946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddeacd9-b418-4a77-8ef0-241afd5608c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.891129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9ddeacd9-b418-4a77-8ef0-241afd5608c3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:22.892354 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9ddeacd9-b418-4a77-8ef0-241afd5608c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:22.901344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 126/247] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:22 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:22.944177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e88b26-7668-438a-9df5-50a3df801a0c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:22.963417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e88b26-7668-438a-9df5-50a3df801a0c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:22.968160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfe6a2-5ec2-4edd-8d7e-28cb7747c3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:22.968984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfe6a2-5ec2-4edd-8d7e-28cb7747c3f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:22.969263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfe6a2-5ec2-4edd-8d7e-28cb7747c3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:22.969535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dfe6a2-5ec2-4edd-8d7e-28cb7747c3f3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:22.987169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dfe6a2-5ec2-4edd-8d7e-28cb7747c3f3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:22.993753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-09dfe6a2-5ec2-4edd-8d7e-28cb7747c3f3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:22.995037 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 122/248] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:22 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:23.001620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeacd9-b418-4a77-8ef0-241afd5608c3 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:23.015432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddeacd9-b418-4a77-8ef0-241afd5608c3 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:23.031581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec801-6a21-4fc1-8f25-6d8cecf5f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:23.032184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec801-6a21-4fc1-8f25-6d8cecf5f8f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:23.032463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec801-6a21-4fc1-8f25-6d8cecf5f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:23.032735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec801-6a21-4fc1-8f25-6d8cecf5f8f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:23.033508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ec801-6a21-4fc1-8f25-6d8cecf5f8f1 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:23.033812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ec801-6a21-4fc1-8f25-6d8cecf5f8f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:23.036081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183ec801-6a21-4fc1-8f25-6d8cecf5f8f1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:23.045846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 127/249] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:23 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:23.052262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfe6a2-5ec2-4edd-8d7e-28cb7747c3f3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:23.062940 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dfe6a2-5ec2-4edd-8d7e-28cb7747c3f3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:23.074750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a388a0-52ca-475b-88ca-0904fa64dde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:23.075419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a388a0-52ca-475b-88ca-0904fa64dde5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:23.075696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a388a0-52ca-475b-88ca-0904fa64dde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:23.075968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a388a0-52ca-475b-88ca-0904fa64dde5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:23.090656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a388a0-52ca-475b-88ca-0904fa64dde5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:23.092400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a388a0-52ca-475b-88ca-0904fa64dde5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:23.108540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 123/250] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:23 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:23.116976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec801-6a21-4fc1-8f25-6d8cecf5f8f1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:23.131848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec801-6a21-4fc1-8f25-6d8cecf5f8f1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:23.141606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca814dc0-6e0a-443a-8ac7-97eb0104e723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:23.142520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814dc0-6e0a-443a-8ac7-97eb0104e723 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:23.142799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814dc0-6e0a-443a-8ac7-97eb0104e723 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:23.143067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca814dc0-6e0a-443a-8ac7-97eb0104e723 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:23.145126 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca814dc0-6e0a-443a-8ac7-97eb0104e723 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:23.151477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca814dc0-6e0a-443a-8ac7-97eb0104e723 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:23.153308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 128/251] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:23 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:23.160340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a388a0-52ca-475b-88ca-0904fa64dde5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:23.173298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a388a0-52ca-475b-88ca-0904fa64dde5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:23.182655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f98adae-7d90-41cb-8a9d-b09d7d91c59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:23.183515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98adae-7d90-41cb-8a9d-b09d7d91c59b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:23.183793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98adae-7d90-41cb-8a9d-b09d7d91c59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:23.184062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f98adae-7d90-41cb-8a9d-b09d7d91c59b admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:23.185272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98adae-7d90-41cb-8a9d-b09d7d91c59b admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:23.187161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f98adae-7d90-41cb-8a9d-b09d7d91c59b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:23.188763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 124/252] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:23 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:23.196173 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca814dc0-6e0a-443a-8ac7-97eb0104e723 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:23.205905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca814dc0-6e0a-443a-8ac7-97eb0104e723 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:23.213894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1fcd84-4b07-4bff-b178-9bfc491959a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:23.214576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fcd84-4b07-4bff-b178-9bfc491959a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:23.214857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fcd84-4b07-4bff-b178-9bfc491959a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:23.215118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1fcd84-4b07-4bff-b178-9bfc491959a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:23.215954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fcd84-4b07-4bff-b178-9bfc491959a6 admin admin] RBAC: Adding query filter params (group.id=110829c5a82e484cb2a67ff51f067241, role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:23.216255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fcd84-4b07-4bff-b178-9bfc491959a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:23.218158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1fcd84-4b07-4bff-b178-9bfc491959a6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:23.224476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 129/253] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:23 2021] GET /identity/v3/role_assignments?group.id=110829c5a82e484cb2a67ff51f067241&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 260 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:23.903775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816a6e0-881b-4ad9-9fc1-12eb20bdd95d None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:23.904794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816a6e0-881b-4ad9-9fc1-12eb20bdd95d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:23.905268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0816a6e0-881b-4ad9-9fc1-12eb20bdd95d None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:23.907278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 125/254] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:23 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:23.913918 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ffcf4-5327-4e3c-9970-bf394efe56d4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:23.914799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ffcf4-5327-4e3c-9970-bf394efe56d4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:23.915303 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ffcf4-5327-4e3c-9970-bf394efe56d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:23.933413 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-635ffcf4-5327-4e3c-9970-bf394efe56d4 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:23.939013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-635ffcf4-5327-4e3c-9970-bf394efe56d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:23.947924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 130/255] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:23 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:23.988079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816a6e0-881b-4ad9-9fc1-12eb20bdd95d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.015939 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0816a6e0-881b-4ad9-9fc1-12eb20bdd95d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.026696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3c314-e3e6-45c0-b26d-e4d069bf2140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.027809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3c314-e3e6-45c0-b26d-e4d069bf2140 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.028300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3c314-e3e6-45c0-b26d-e4d069bf2140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.028779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db3c314-e3e6-45c0-b26d-e4d069bf2140 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.039911 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db3c314-e3e6-45c0-b26d-e4d069bf2140 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:24.046993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-6db3c314-e3e6-45c0-b26d-e4d069bf2140 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:24.048411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 126/256] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:23 2021] GET /identity/v3/roles/member => generated 84 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:24.054995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ffcf4-5327-4e3c-9970-bf394efe56d4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.064304 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ffcf4-5327-4e3c-9970-bf394efe56d4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.074014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51267-d52c-4aa6-ba3b-6ef41ac9965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.074938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51267-d52c-4aa6-ba3b-6ef41ac9965c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.075428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51267-d52c-4aa6-ba3b-6ef41ac9965c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.075888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b51267-d52c-4aa6-ba3b-6ef41ac9965c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.076861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b51267-d52c-4aa6-ba3b-6ef41ac9965c admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:24.077353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b51267-d52c-4aa6-ba3b-6ef41ac9965c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.079141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b51267-d52c-4aa6-ba3b-6ef41ac9965c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.092853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 131/257] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:24.099654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3c314-e3e6-45c0-b26d-e4d069bf2140 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.109616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db3c314-e3e6-45c0-b26d-e4d069bf2140 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.116874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ded7-20b1-4312-be04-8b5c795b7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.117839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ded7-20b1-4312-be04-8b5c795b7780 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.118351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ded7-20b1-4312-be04-8b5c795b7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.118816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ded7-20b1-4312-be04-8b5c795b7780 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.130745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341ded7-20b1-4312-be04-8b5c795b7780 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.132729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341ded7-20b1-4312-be04-8b5c795b7780 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.147883 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 127/258] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:24.154579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51267-d52c-4aa6-ba3b-6ef41ac9965c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.165146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b51267-d52c-4aa6-ba3b-6ef41ac9965c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.174011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee89e5-abf7-4e5e-adb3-f8544a8b7ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.175357 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee89e5-abf7-4e5e-adb3-f8544a8b7ed5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.175895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee89e5-abf7-4e5e-adb3-f8544a8b7ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.176356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee89e5-abf7-4e5e-adb3-f8544a8b7ed5 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.177732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee89e5-abf7-4e5e-adb3-f8544a8b7ed5 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.179998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee89e5-abf7-4e5e-adb3-f8544a8b7ed5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.181961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 132/259] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:24.189705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ded7-20b1-4312-be04-8b5c795b7780 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.199655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ded7-20b1-4312-be04-8b5c795b7780 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.210276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b25a98-f0b9-4cfa-ba25-0eb16e5fa6ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.211575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25a98-f0b9-4cfa-ba25-0eb16e5fa6ec admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.212052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25a98-f0b9-4cfa-ba25-0eb16e5fa6ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.212512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b25a98-f0b9-4cfa-ba25-0eb16e5fa6ec admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.213894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b25a98-f0b9-4cfa-ba25-0eb16e5fa6ec admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.215976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b25a98-f0b9-4cfa-ba25-0eb16e5fa6ec admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.217843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 128/260] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:24.225472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee89e5-abf7-4e5e-adb3-f8544a8b7ed5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.235447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee89e5-abf7-4e5e-adb3-f8544a8b7ed5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.245972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad5907-5139-4fa8-9260-9a57199078f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.246919 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5907-5139-4fa8-9260-9a57199078f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.247392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5907-5139-4fa8-9260-9a57199078f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.247853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad5907-5139-4fa8-9260-9a57199078f6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.248879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad5907-5139-4fa8-9260-9a57199078f6 admin admin] RBAC: Adding query filter params (group.id=110829c5a82e484cb2a67ff51f067241, role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=a767e19648dd4ee78d2439f37a731774) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:24.249378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad5907-5139-4fa8-9260-9a57199078f6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.251435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad5907-5139-4fa8-9260-9a57199078f6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.258531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 133/261] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/role_assignments?group.id=110829c5a82e484cb2a67ff51f067241&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 260 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:24.569080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a30bc0-dc26-4ed9-9626-9fead9fbd672 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.569727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a30bc0-dc26-4ed9-9626-9fead9fbd672 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.570233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a30bc0-dc26-4ed9-9626-9fead9fbd672 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.572268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 129/262] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:24.579223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677d0a-0ff0-46e6-b454-46ec67f6e901 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.579522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677d0a-0ff0-46e6-b454-46ec67f6e901 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.579769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52677d0a-0ff0-46e6-b454-46ec67f6e901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.611723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-52677d0a-0ff0-46e6-b454-46ec67f6e901 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:24.612981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-52677d0a-0ff0-46e6-b454-46ec67f6e901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:24.625008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 134/263] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:24.653422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a30bc0-dc26-4ed9-9626-9fead9fbd672 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.675344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a30bc0-dc26-4ed9-9626-9fead9fbd672 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.680117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781ef67-f0b9-4d1a-999c-c3695b8ad198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.681155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781ef67-f0b9-4d1a-999c-c3695b8ad198 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.681625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781ef67-f0b9-4d1a-999c-c3695b8ad198 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.682108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781ef67-f0b9-4d1a-999c-c3695b8ad198 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.697119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781ef67-f0b9-4d1a-999c-c3695b8ad198 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:24.704543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-9781ef67-f0b9-4d1a-999c-c3695b8ad198 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:24.705961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 130/264] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:24.713338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52677d0a-0ff0-46e6-b454-46ec67f6e901 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.727601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52677d0a-0ff0-46e6-b454-46ec67f6e901 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.738693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f11bb-6845-4623-b0a4-acfcab9e4fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.739364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f11bb-6845-4623-b0a4-acfcab9e4fdb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.739640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f11bb-6845-4623-b0a4-acfcab9e4fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.739911 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f11bb-6845-4623-b0a4-acfcab9e4fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.740678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f11bb-6845-4623-b0a4-acfcab9e4fdb admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:24.740977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f11bb-6845-4623-b0a4-acfcab9e4fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.742586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f11bb-6845-4623-b0a4-acfcab9e4fdb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.749287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65acf2-9662-4602-9083-cfacc6db8c43 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.749885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65acf2-9662-4602-9083-cfacc6db8c43 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.750369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b65acf2-9662-4602-9083-cfacc6db8c43 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.753405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 131/265] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:24 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:24.754455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 135/266] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:24.760499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27276f3-5016-4651-932f-523d8159d673 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.760621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f11bb-6845-4623-b0a4-acfcab9e4fdb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.761092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27276f3-5016-4651-932f-523d8159d673 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.761557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27276f3-5016-4651-932f-523d8159d673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.774359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f11bb-6845-4623-b0a4-acfcab9e4fdb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.789382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df7b17-cec6-415f-9ba6-c714bf641804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.790051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df7b17-cec6-415f-9ba6-c714bf641804 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.790404 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df7b17-cec6-415f-9ba6-c714bf641804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.790675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94df7b17-cec6-415f-9ba6-c714bf641804 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.792103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c27276f3-5016-4651-932f-523d8159d673 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:24.793278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c27276f3-5016-4651-932f-523d8159d673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:24.803291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df7b17-cec6-415f-9ba6-c714bf641804 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.805061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94df7b17-cec6-415f-9ba6-c714bf641804 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.810734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 132/267] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:24 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:24.819885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 136/268] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:00:24.825826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27276f3-5016-4651-932f-523d8159d673 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.836423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27276f3-5016-4651-932f-523d8159d673 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.844676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df7b17-cec6-415f-9ba6-c714bf641804 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.844815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f316-1fb4-4ab5-bdbf-e9f3936eabc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.846581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f316-1fb4-4ab5-bdbf-e9f3936eabc5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.846581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f316-1fb4-4ab5-bdbf-e9f3936eabc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.846581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0862f316-1fb4-4ab5-bdbf-e9f3936eabc5 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.847957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862f316-1fb4-4ab5-bdbf-e9f3936eabc5 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.850117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0862f316-1fb4-4ab5-bdbf-e9f3936eabc5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.852068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 133/269] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:24.857065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94df7b17-cec6-415f-9ba6-c714bf641804 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.866051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f316-1fb4-4ab5-bdbf-e9f3936eabc5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.866215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1709f1-65b9-4643-a5d9-f7afb95aa9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.866215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1709f1-65b9-4643-a5d9-f7afb95aa9ba admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.866215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1709f1-65b9-4643-a5d9-f7afb95aa9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.866215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1709f1-65b9-4643-a5d9-f7afb95aa9ba admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.876929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0862f316-1fb4-4ab5-bdbf-e9f3936eabc5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.886466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29614c-9c74-4541-b2d9-456ba2d17f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.887374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29614c-9c74-4541-b2d9-456ba2d17f08 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.887658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29614c-9c74-4541-b2d9-456ba2d17f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.887929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f29614c-9c74-4541-b2d9-456ba2d17f08 admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.891786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29614c-9c74-4541-b2d9-456ba2d17f08 admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.892924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1709f1-65b9-4643-a5d9-f7afb95aa9ba admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:24.897100 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f29614c-9c74-4541-b2d9-456ba2d17f08 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.901371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 134/270] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:24.904814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-ff1709f1-65b9-4643-a5d9-f7afb95aa9ba admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:24.906281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 137/271] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/roles/admin => generated 83 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:24.909940 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29614c-9c74-4541-b2d9-456ba2d17f08 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.913176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1709f1-65b9-4643-a5d9-f7afb95aa9ba admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.925722 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f29614c-9c74-4541-b2d9-456ba2d17f08 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.930347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1709f1-65b9-4643-a5d9-f7afb95aa9ba admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.934758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f858d1-9c3d-44a5-88ec-bddf148d2b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.935433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f858d1-9c3d-44a5-88ec-bddf148d2b53 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.935715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f858d1-9c3d-44a5-88ec-bddf148d2b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.935987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f858d1-9c3d-44a5-88ec-bddf148d2b53 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.936855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f858d1-9c3d-44a5-88ec-bddf148d2b53 admin admin] RBAC: Adding query filter params (group.id=110829c5a82e484cb2a67ff51f067241, role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=a767e19648dd4ee78d2439f37a731774) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:24.937232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f858d1-9c3d-44a5-88ec-bddf148d2b53 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.939245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f858d1-9c3d-44a5-88ec-bddf148d2b53 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.941597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feebb74-83ba-452e-9a0d-ec4915a19372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.942595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feebb74-83ba-452e-9a0d-ec4915a19372 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.943073 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feebb74-83ba-452e-9a0d-ec4915a19372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.943533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feebb74-83ba-452e-9a0d-ec4915a19372 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:24.944519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feebb74-83ba-452e-9a0d-ec4915a19372 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:24.945030 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feebb74-83ba-452e-9a0d-ec4915a19372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:24.946199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 135/272] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/role_assignments?group.id=110829c5a82e484cb2a67ff51f067241&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 260 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:24.947113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feebb74-83ba-452e-9a0d-ec4915a19372 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:24.959430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 138/273] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:24.966081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f858d1-9c3d-44a5-88ec-bddf148d2b53 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:24.976610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f858d1-9c3d-44a5-88ec-bddf148d2b53 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:24.981853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afdc7e-d785-496b-99fb-a66d9786a3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:24.988373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afdc7e-d785-496b-99fb-a66d9786a3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:24.988875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afdc7e-d785-496b-99fb-a66d9786a3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:24.989414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4afdc7e-d785-496b-99fb-a66d9786a3e6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.005599 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afdc7e-d785-496b-99fb-a66d9786a3e6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:25.007619 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4afdc7e-d785-496b-99fb-a66d9786a3e6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:25.016705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 136/274] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:24 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:25.024415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feebb74-83ba-452e-9a0d-ec4915a19372 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:25.035021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feebb74-83ba-452e-9a0d-ec4915a19372 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:25.040632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1277a81-4ee1-4073-8d12-7df681f31d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:25.041760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1277a81-4ee1-4073-8d12-7df681f31d99 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:25.042265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1277a81-4ee1-4073-8d12-7df681f31d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:25.042750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1277a81-4ee1-4073-8d12-7df681f31d99 admin admin] PATH_INFO: `/v3/projects/3355962a746e4ae38c08a8001aa0f51d` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.044137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1277a81-4ee1-4073-8d12-7df681f31d99 admin admin] RBAC: Authorizing `identity:get_project(project_id=3355962a746e4ae38c08a8001aa0f51d)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:25.046128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1277a81-4ee1-4073-8d12-7df681f31d99 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:25.048275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 139/275] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:25 2021] GET /identity/v3/projects/3355962a746e4ae38c08a8001aa0f51d => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:25.055189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afdc7e-d785-496b-99fb-a66d9786a3e6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:25.064876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4afdc7e-d785-496b-99fb-a66d9786a3e6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:25.072158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba776fb6-b249-4d61-baf5-f2c8a6f01499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:25.073315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776fb6-b249-4d61-baf5-f2c8a6f01499 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:25.073837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776fb6-b249-4d61-baf5-f2c8a6f01499 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:25.074384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba776fb6-b249-4d61-baf5-f2c8a6f01499 admin admin] PATH_INFO: `/v3/groups/ca47c19d3a94483e8acef5918300b09b` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.082198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba776fb6-b249-4d61-baf5-f2c8a6f01499 admin admin] RBAC: Authorizing `identity:get_group(group_id=ca47c19d3a94483e8acef5918300b09b)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:25.084532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba776fb6-b249-4d61-baf5-f2c8a6f01499 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:25.086541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 137/276] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:25 2021] GET /identity/v3/groups/ca47c19d3a94483e8acef5918300b09b => generated 229 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:25.093211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1277a81-4ee1-4073-8d12-7df681f31d99 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:25.106186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1277a81-4ee1-4073-8d12-7df681f31d99 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:25.113046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37cd56-0eee-48dd-90c2-28de4a691bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:25.114203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37cd56-0eee-48dd-90c2-28de4a691bff admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:25.114485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37cd56-0eee-48dd-90c2-28de4a691bff admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:25.114809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37cd56-0eee-48dd-90c2-28de4a691bff admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.115670 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37cd56-0eee-48dd-90c2-28de4a691bff admin admin] RBAC: Adding query filter params (group.id=ca47c19d3a94483e8acef5918300b09b, role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=3355962a746e4ae38c08a8001aa0f51d) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:25.115979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37cd56-0eee-48dd-90c2-28de4a691bff admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:25.118046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37cd56-0eee-48dd-90c2-28de4a691bff admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:25.125265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 140/277] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:25 2021] GET /identity/v3/role_assignments?group.id=ca47c19d3a94483e8acef5918300b09b&scope.project.id=3355962a746e4ae38c08a8001aa0f51d&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 260 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:25.721153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850f65-7351-4f35-b854-8f9d117f6f1c None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:25.721865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850f65-7351-4f35-b854-8f9d117f6f1c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:25.723068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00850f65-7351-4f35-b854-8f9d117f6f1c None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.725292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 138/278] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:25 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:25.731025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015de2-31eb-478b-9572-392421227774 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:25.731306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015de2-31eb-478b-9572-392421227774 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:25.731578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d015de2-31eb-478b-9572-392421227774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.754638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5d015de2-31eb-478b-9572-392421227774 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:25.755809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5d015de2-31eb-478b-9572-392421227774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:25.768130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 141/279] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:25 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:25.804878 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850f65-7351-4f35-b854-8f9d117f6f1c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:25.820400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00850f65-7351-4f35-b854-8f9d117f6f1c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:25.826216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaaf02-1b1a-4496-b41f-6ac6e622d1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:25.827249 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaaf02-1b1a-4496-b41f-6ac6e622d1be admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:25.827729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaaf02-1b1a-4496-b41f-6ac6e622d1be admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:25.828188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfaaf02-1b1a-4496-b41f-6ac6e622d1be admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.843074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfaaf02-1b1a-4496-b41f-6ac6e622d1be admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:25.850523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-ccfaaf02-1b1a-4496-b41f-6ac6e622d1be admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:25.852277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 139/280] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:25 2021] GET /identity/v3/roles/member => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:25.858364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015de2-31eb-478b-9572-392421227774 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:25.873510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d015de2-31eb-478b-9572-392421227774 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:25.884947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c5a5f-35d3-4b28-aff2-d5578f6782a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:25.885619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5a5f-35d3-4b28-aff2-d5578f6782a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:25.885893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5a5f-35d3-4b28-aff2-d5578f6782a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:25.886184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c5a5f-35d3-4b28-aff2-d5578f6782a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.886959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c5a5f-35d3-4b28-aff2-d5578f6782a9 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:25.887259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c5a5f-35d3-4b28-aff2-d5578f6782a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:25.888865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c5a5f-35d3-4b28-aff2-d5578f6782a9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:25.902208 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 142/281] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:25 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:25.908502 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaaf02-1b1a-4496-b41f-6ac6e622d1be admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:25.919107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfaaf02-1b1a-4496-b41f-6ac6e622d1be admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:25.924236 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3387d-1539-4d08-b73d-d3ca410ba2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:25.925981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3387d-1539-4d08-b73d-d3ca410ba2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:25.926479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3387d-1539-4d08-b73d-d3ca410ba2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:25.926994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3387d-1539-4d08-b73d-d3ca410ba2a9 admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.928346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3387d-1539-4d08-b73d-d3ca410ba2a9 admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:25.930450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3387d-1539-4d08-b73d-d3ca410ba2a9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:25.932257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 140/282] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:25 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:25.938444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c5a5f-35d3-4b28-aff2-d5578f6782a9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:25.951766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c5a5f-35d3-4b28-aff2-d5578f6782a9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:25.956516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f085358b-061e-4022-b19e-b131110530c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:25.957365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085358b-061e-4022-b19e-b131110530c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:25.957640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085358b-061e-4022-b19e-b131110530c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:25.957906 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f085358b-061e-4022-b19e-b131110530c4 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:25.959123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085358b-061e-4022-b19e-b131110530c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:25.961133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f085358b-061e-4022-b19e-b131110530c4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:25.962977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 143/283] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:25 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:25.969049 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3387d-1539-4d08-b73d-d3ca410ba2a9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:25.988669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3387d-1539-4d08-b73d-d3ca410ba2a9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:26.003396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e709a4-c45f-466b-92ff-2f59195ef589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:26.004716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e709a4-c45f-466b-92ff-2f59195ef589 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:26.005674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e709a4-c45f-466b-92ff-2f59195ef589 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:26.006170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e709a4-c45f-466b-92ff-2f59195ef589 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/groups/110829c5a82e484cb2a67ff51f067241/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:26.008350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e709a4-c45f-466b-92ff-2f59195ef589 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4f8cf5773f4074b83a335c1b11f025, group_id=110829c5a82e484cb2a67ff51f067241, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:26.011278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e709a4-c45f-466b-92ff-2f59195ef589 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:26.109227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 141/284] 10.222.0.32 () {58 vars in 1463 bytes} [Wed Oct 27 01:00:25 2021] PUT /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/groups/110829c5a82e484cb2a67ff51f067241/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:26.242838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a992f-e182-4d29-af5e-701bf67155d4 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:26.243170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a992f-e182-4d29-af5e-701bf67155d4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:26.243342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a992f-e182-4d29-af5e-701bf67155d4 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:26.245057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 144/285] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:26.251472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda495-9301-433e-ae5e-600a46e51123 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:26.252076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda495-9301-433e-ae5e-600a46e51123 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:26.252581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcda495-9301-433e-ae5e-600a46e51123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:26.275462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-6dcda495-9301-433e-ae5e-600a46e51123 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:26.276985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6dcda495-9301-433e-ae5e-600a46e51123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:26.353377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 142/286] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:26 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:26.388970 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a992f-e182-4d29-af5e-701bf67155d4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:26.408221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a992f-e182-4d29-af5e-701bf67155d4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:26.416328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563181c3-0ad6-4edd-b8c1-9c2bb8c44e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:26.417134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563181c3-0ad6-4edd-b8c1-9c2bb8c44e7b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:26.417404 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563181c3-0ad6-4edd-b8c1-9c2bb8c44e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:26.417666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563181c3-0ad6-4edd-b8c1-9c2bb8c44e7b admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:26.432005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563181c3-0ad6-4edd-b8c1-9c2bb8c44e7b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:26.439687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-563181c3-0ad6-4edd-b8c1-9c2bb8c44e7b admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:26.441112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 145/287] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:26 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:26.447611 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcda495-9301-433e-ae5e-600a46e51123 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:26.463191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcda495-9301-433e-ae5e-600a46e51123 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:26.469121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679315f5-a8c3-4f09-9ea2-bfe671568205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:26.470040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679315f5-a8c3-4f09-9ea2-bfe671568205 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:26.470514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679315f5-a8c3-4f09-9ea2-bfe671568205 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:26.470995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679315f5-a8c3-4f09-9ea2-bfe671568205 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:26.472475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679315f5-a8c3-4f09-9ea2-bfe671568205 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:26.472974 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679315f5-a8c3-4f09-9ea2-bfe671568205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:26.474793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679315f5-a8c3-4f09-9ea2-bfe671568205 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:26.485547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 143/288] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:26 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:26.493315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563181c3-0ad6-4edd-b8c1-9c2bb8c44e7b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:26.504696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563181c3-0ad6-4edd-b8c1-9c2bb8c44e7b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:26.509365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd7d2b-bcce-41f7-98ba-4c4bca1b051b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:26.510461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7d2b-bcce-41f7-98ba-4c4bca1b051b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:26.510931 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7d2b-bcce-41f7-98ba-4c4bca1b051b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:26.512420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bd7d2b-bcce-41f7-98ba-4c4bca1b051b admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:26.512879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd7d2b-bcce-41f7-98ba-4c4bca1b051b admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:26.514086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-44bd7d2b-bcce-41f7-98ba-4c4bca1b051b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_group failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:26.514086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:00:26.514086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:00:26.515613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bd7d2b-bcce-41f7-98ba-4c4bca1b051b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:26.517814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 146/289] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:26 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:26.524702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679315f5-a8c3-4f09-9ea2-bfe671568205 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:26.536190 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679315f5-a8c3-4f09-9ea2-bfe671568205 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:26.541029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8100401-dd5a-4ae1-bcb0-db67cc1c7cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:26.542144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8100401-dd5a-4ae1-bcb0-db67cc1c7cb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:26.542602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8100401-dd5a-4ae1-bcb0-db67cc1c7cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:26.543013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8100401-dd5a-4ae1-bcb0-db67cc1c7cb5 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:26.544489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8100401-dd5a-4ae1-bcb0-db67cc1c7cb5 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:26.546863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8100401-dd5a-4ae1-bcb0-db67cc1c7cb5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:26.549068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 144/290] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:26 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:26.557783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd7d2b-bcce-41f7-98ba-4c4bca1b051b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:26.568290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bd7d2b-bcce-41f7-98ba-4c4bca1b051b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:26.572831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02665c07-9aae-4593-bfb5-1e68a4d99a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:26.573851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02665c07-9aae-4593-bfb5-1e68a4d99a59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:26.576437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02665c07-9aae-4593-bfb5-1e68a4d99a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:26.576871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02665c07-9aae-4593-bfb5-1e68a4d99a59 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/groups/110829c5a82e484cb2a67ff51f067241/roles/3e47746460b74dbb90c678ac5b65a01a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:26.579278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02665c07-9aae-4593-bfb5-1e68a4d99a59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d4f8cf5773f4074b83a335c1b11f025, group_id=110829c5a82e484cb2a67ff51f067241, role_id=3e47746460b74dbb90c678ac5b65a01a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:26.582859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02665c07-9aae-4593-bfb5-1e68a4d99a59 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:26.656959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 147/291] 10.222.0.32 () {58 vars in 1463 bytes} [Wed Oct 27 01:00:26 2021] PUT /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025/groups/110829c5a82e484cb2a67ff51f067241/roles/3e47746460b74dbb90c678ac5b65a01a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:27.250160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb00724-adb8-4258-8d12-566c5c6a2e3b None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:27.250963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb00724-adb8-4258-8d12-566c5c6a2e3b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:27.251381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb00724-adb8-4258-8d12-566c5c6a2e3b None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:27.253340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 145/292] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:27.259889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42356e0-194a-44f3-b323-671727b7a3d4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:27.260791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42356e0-194a-44f3-b323-671727b7a3d4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:27.261258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42356e0-194a-44f3-b323-671727b7a3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:27.286318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f42356e0-194a-44f3-b323-671727b7a3d4 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:27.287820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f42356e0-194a-44f3-b323-671727b7a3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:27.353455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 148/293] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:27.386270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb00724-adb8-4258-8d12-566c5c6a2e3b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:27.401069 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb00724-adb8-4258-8d12-566c5c6a2e3b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:27.405595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ab287-126e-4395-a3e2-4afd338c6bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:27.406630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ab287-126e-4395-a3e2-4afd338c6bcd admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:27.407196 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ab287-126e-4395-a3e2-4afd338c6bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:27.407676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ab287-126e-4395-a3e2-4afd338c6bcd admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:27.422976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ab287-126e-4395-a3e2-4afd338c6bcd admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:27.430749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-781ab287-126e-4395-a3e2-4afd338c6bcd admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:27.432156 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 146/294] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:27 2021] GET /identity/v3/roles/member => generated 84 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:27.438788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42356e0-194a-44f3-b323-671727b7a3d4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:27.449138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42356e0-194a-44f3-b323-671727b7a3d4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:27.453773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9375a-59d6-4d1e-83de-185ce2f83d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:27.454703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9375a-59d6-4d1e-83de-185ce2f83d6d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:27.455159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9375a-59d6-4d1e-83de-185ce2f83d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:27.460978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9375a-59d6-4d1e-83de-185ce2f83d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:27.460978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9375a-59d6-4d1e-83de-185ce2f83d6d admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:27.460978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9375a-59d6-4d1e-83de-185ce2f83d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:27.460978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9375a-59d6-4d1e-83de-185ce2f83d6d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:27.473850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 149/295] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:27 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:27.480551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ab287-126e-4395-a3e2-4afd338c6bcd admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:27.491577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ab287-126e-4395-a3e2-4afd338c6bcd admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:27.502086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f9c92-871f-4694-86ef-825e0dbc2fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:27.503749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f9c92-871f-4694-86ef-825e0dbc2fee admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:27.504096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f9c92-871f-4694-86ef-825e0dbc2fee admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:27.504317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f9c92-871f-4694-86ef-825e0dbc2fee admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:27.510740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f9c92-871f-4694-86ef-825e0dbc2fee admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:27.512639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f9c92-871f-4694-86ef-825e0dbc2fee admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:27.514288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 147/296] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:27 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:27.520930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9375a-59d6-4d1e-83de-185ce2f83d6d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:27.535304 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9375a-59d6-4d1e-83de-185ce2f83d6d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:27.539623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff1a0f5-7fa8-4eba-816a-65e5fa4904b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:27.540496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1a0f5-7fa8-4eba-816a-65e5fa4904b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:27.540770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1a0f5-7fa8-4eba-816a-65e5fa4904b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:27.541041 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff1a0f5-7fa8-4eba-816a-65e5fa4904b8 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:27.542273 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1a0f5-7fa8-4eba-816a-65e5fa4904b8 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:27.544301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff1a0f5-7fa8-4eba-816a-65e5fa4904b8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:27.546124 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 150/297] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:27 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:27.553170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f9c92-871f-4694-86ef-825e0dbc2fee admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:27.563022 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f9c92-871f-4694-86ef-825e0dbc2fee admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:27.573962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fbe4b4-0b17-470c-8055-6ce014ed3e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:27.574848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe4b4-0b17-470c-8055-6ce014ed3e14 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:27.575123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe4b4-0b17-470c-8055-6ce014ed3e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:27.575393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fbe4b4-0b17-470c-8055-6ce014ed3e14 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774/groups/110829c5a82e484cb2a67ff51f067241/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:27.578206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbe4b4-0b17-470c-8055-6ce014ed3e14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767e19648dd4ee78d2439f37a731774, group_id=110829c5a82e484cb2a67ff51f067241, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:27.580776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fbe4b4-0b17-470c-8055-6ce014ed3e14 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:27.657152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 148/298] 10.222.0.32 () {58 vars in 1463 bytes} [Wed Oct 27 01:00:27 2021] PUT /identity/v3/projects/a767e19648dd4ee78d2439f37a731774/groups/110829c5a82e484cb2a67ff51f067241/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:27.914922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad339483-3104-42a7-8932-b089817d6639 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:27.914922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad339483-3104-42a7-8932-b089817d6639 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:27.914922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad339483-3104-42a7-8932-b089817d6639 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:27.918003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 151/299] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:27.923747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c2685-77f7-4f27-ac3d-c20c386941f0 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:27.924034 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c2685-77f7-4f27-ac3d-c20c386941f0 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:27.924297 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0c2685-77f7-4f27-ac3d-c20c386941f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:27.946533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0b0c2685-77f7-4f27-ac3d-c20c386941f0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:27.947843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0b0c2685-77f7-4f27-ac3d-c20c386941f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:28.015945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 149/300] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:27 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:28.043858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad339483-3104-42a7-8932-b089817d6639 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.057885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad339483-3104-42a7-8932-b089817d6639 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.062376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cba91f-cfe4-41b2-b5ad-25b9e07fbea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.063224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cba91f-cfe4-41b2-b5ad-25b9e07fbea9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.063502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cba91f-cfe4-41b2-b5ad-25b9e07fbea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.063771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cba91f-cfe4-41b2-b5ad-25b9e07fbea9 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.076289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cba91f-cfe4-41b2-b5ad-25b9e07fbea9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:28.084424 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-99cba91f-cfe4-41b2-b5ad-25b9e07fbea9 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:28.085955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 152/301] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:28 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:28.092489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c2685-77f7-4f27-ac3d-c20c386941f0 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.102213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0c2685-77f7-4f27-ac3d-c20c386941f0 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.106820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc6122-1863-45b8-bc42-3327717bde50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.107544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc6122-1863-45b8-bc42-3327717bde50 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.107819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc6122-1863-45b8-bc42-3327717bde50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.108087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc6122-1863-45b8-bc42-3327717bde50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.108904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc6122-1863-45b8-bc42-3327717bde50 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:28.109204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc6122-1863-45b8-bc42-3327717bde50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:28.110886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc6122-1863-45b8-bc42-3327717bde50 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:28.120715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 150/302] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:28 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:28.127202 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cba91f-cfe4-41b2-b5ad-25b9e07fbea9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.138375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cba91f-cfe4-41b2-b5ad-25b9e07fbea9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.143123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce634f59-0c72-419f-937c-a88692519aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.144083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce634f59-0c72-419f-937c-a88692519aae admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.144334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce634f59-0c72-419f-937c-a88692519aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.144660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce634f59-0c72-419f-937c-a88692519aae admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.145888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce634f59-0c72-419f-937c-a88692519aae admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:28.147858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce634f59-0c72-419f-937c-a88692519aae admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:28.149756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 153/303] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:28 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:28.156113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc6122-1863-45b8-bc42-3327717bde50 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.166473 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc6122-1863-45b8-bc42-3327717bde50 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.171063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bafd1-e5c5-4779-94b8-699018e212fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.171962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bafd1-e5c5-4779-94b8-699018e212fe admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.172237 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bafd1-e5c5-4779-94b8-699018e212fe admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.172506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bafd1-e5c5-4779-94b8-699018e212fe admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.173840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bafd1-e5c5-4779-94b8-699018e212fe admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:28.176815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529bafd1-e5c5-4779-94b8-699018e212fe admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:28.179066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 151/304] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:28 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:28.185405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce634f59-0c72-419f-937c-a88692519aae admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.196207 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce634f59-0c72-419f-937c-a88692519aae admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.200693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b929c68-9d73-4ded-a678-281e04a6faf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.201560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929c68-9d73-4ded-a678-281e04a6faf6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.201880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929c68-9d73-4ded-a678-281e04a6faf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.202184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b929c68-9d73-4ded-a678-281e04a6faf6 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774/groups/110829c5a82e484cb2a67ff51f067241/roles/3e47746460b74dbb90c678ac5b65a01a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.204629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b929c68-9d73-4ded-a678-281e04a6faf6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a767e19648dd4ee78d2439f37a731774, group_id=110829c5a82e484cb2a67ff51f067241, role_id=3e47746460b74dbb90c678ac5b65a01a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:28.207998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b929c68-9d73-4ded-a678-281e04a6faf6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:28.320897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 154/305] 10.222.0.32 () {58 vars in 1463 bytes} [Wed Oct 27 01:00:28 2021] PUT /identity/v3/projects/a767e19648dd4ee78d2439f37a731774/groups/110829c5a82e484cb2a67ff51f067241/roles/3e47746460b74dbb90c678ac5b65a01a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:28.479700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab85511-9ec8-4385-8cad-fe2c5a650353 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.480362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab85511-9ec8-4385-8cad-fe2c5a650353 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.480362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab85511-9ec8-4385-8cad-fe2c5a650353 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.482263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 152/306] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:28.497132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa42f-c363-4277-8da3-68625fbce9eb None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.497455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa42f-c363-4277-8da3-68625fbce9eb None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.497671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12efa42f-c363-4277-8da3-68625fbce9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.527143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-12efa42f-c363-4277-8da3-68625fbce9eb None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:28.528363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-12efa42f-c363-4277-8da3-68625fbce9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:28.589598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 155/307] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:28 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:28.621855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab85511-9ec8-4385-8cad-fe2c5a650353 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.644677 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab85511-9ec8-4385-8cad-fe2c5a650353 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.649038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fb311-f6f9-40cb-ab4a-a69e926a745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.650147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fb311-f6f9-40cb-ab4a-a69e926a745a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.650650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fb311-f6f9-40cb-ab4a-a69e926a745a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.651127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466fb311-f6f9-40cb-ab4a-a69e926a745a admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.670799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466fb311-f6f9-40cb-ab4a-a69e926a745a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:28.678127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-466fb311-f6f9-40cb-ab4a-a69e926a745a admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:28.679773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 153/308] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:28.686102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efa42f-c363-4277-8da3-68625fbce9eb None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.701528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12efa42f-c363-4277-8da3-68625fbce9eb None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.711065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3984c40-3010-4c1f-94b1-7e173ab82879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.712084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3984c40-3010-4c1f-94b1-7e173ab82879 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.712605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3984c40-3010-4c1f-94b1-7e173ab82879 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.713082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3984c40-3010-4c1f-94b1-7e173ab82879 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.714132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3984c40-3010-4c1f-94b1-7e173ab82879 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:28.714683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3984c40-3010-4c1f-94b1-7e173ab82879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:28.716526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3984c40-3010-4c1f-94b1-7e173ab82879 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:28.727570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 156/309] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:28 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:28.733654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fb311-f6f9-40cb-ab4a-a69e926a745a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.746117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466fb311-f6f9-40cb-ab4a-a69e926a745a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.751294 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d689cb-5e13-453d-8b90-97425404ff27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.752401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d689cb-5e13-453d-8b90-97425404ff27 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.752981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d689cb-5e13-453d-8b90-97425404ff27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.753626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d689cb-5e13-453d-8b90-97425404ff27 admin admin] PATH_INFO: `/v3/groups/ca47c19d3a94483e8acef5918300b09b` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.755328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d689cb-5e13-453d-8b90-97425404ff27 admin admin] RBAC: Authorizing `identity:get_group(group_id=ca47c19d3a94483e8acef5918300b09b)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:28.757462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d689cb-5e13-453d-8b90-97425404ff27 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:28.759506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 154/310] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:28 2021] GET /identity/v3/groups/ca47c19d3a94483e8acef5918300b09b => generated 229 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:28.765570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3984c40-3010-4c1f-94b1-7e173ab82879 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.777860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3984c40-3010-4c1f-94b1-7e173ab82879 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.783360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b7b8fa-9cc7-4100-b025-c700477e2218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.785337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7b8fa-9cc7-4100-b025-c700477e2218 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.785892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7b8fa-9cc7-4100-b025-c700477e2218 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.786369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b7b8fa-9cc7-4100-b025-c700477e2218 admin admin] PATH_INFO: `/v3/projects/3355962a746e4ae38c08a8001aa0f51d` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.790299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7b8fa-9cc7-4100-b025-c700477e2218 admin admin] RBAC: Authorizing `identity:get_project(project_id=3355962a746e4ae38c08a8001aa0f51d)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:28.790299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b7b8fa-9cc7-4100-b025-c700477e2218 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:28.791940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 157/311] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:28 2021] GET /identity/v3/projects/3355962a746e4ae38c08a8001aa0f51d => generated 344 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:28.798717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d689cb-5e13-453d-8b90-97425404ff27 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:28.815008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d689cb-5e13-453d-8b90-97425404ff27 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:28.820749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58e50a8-c7cf-418d-94ce-aeb81771cb2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:28.824051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e50a8-c7cf-418d-94ce-aeb81771cb2a admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:28.824585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e50a8-c7cf-418d-94ce-aeb81771cb2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:28.825054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58e50a8-c7cf-418d-94ce-aeb81771cb2a admin admin] PATH_INFO: `/v3/projects/3355962a746e4ae38c08a8001aa0f51d/groups/ca47c19d3a94483e8acef5918300b09b/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:28.827322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e50a8-c7cf-418d-94ce-aeb81771cb2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3355962a746e4ae38c08a8001aa0f51d, group_id=ca47c19d3a94483e8acef5918300b09b, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:28.832656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58e50a8-c7cf-418d-94ce-aeb81771cb2a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:28.909597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 155/312] 10.222.0.32 () {58 vars in 1463 bytes} [Wed Oct 27 01:00:28 2021] PUT /identity/v3/projects/3355962a746e4ae38c08a8001aa0f51d/groups/ca47c19d3a94483e8acef5918300b09b/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:00:29.332886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afccae0-af39-455d-a320-dba2329c22e9 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.333371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afccae0-af39-455d-a320-dba2329c22e9 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.333371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afccae0-af39-455d-a320-dba2329c22e9 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.335171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 158/313] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:29.341389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932006-630f-4a49-97da-1bf22bcbad4d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.341827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932006-630f-4a49-97da-1bf22bcbad4d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.342133 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c932006-630f-4a49-97da-1bf22bcbad4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.361537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-3c932006-630f-4a49-97da-1bf22bcbad4d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:29.363498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-3c932006-630f-4a49-97da-1bf22bcbad4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:29.542812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 156/314] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:29.570500 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afccae0-af39-455d-a320-dba2329c22e9 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:29.593463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afccae0-af39-455d-a320-dba2329c22e9 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:29.611305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1b78-29b1-4316-b4b9-2e3e7753d4ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:29.612105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1b78-29b1-4316-b4b9-2e3e7753d4ce admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.612410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1b78-29b1-4316-b4b9-2e3e7753d4ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.612685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1b78-29b1-4316-b4b9-2e3e7753d4ce admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.628941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a1b78-29b1-4316-b4b9-2e3e7753d4ce admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:29.635889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-876a1b78-29b1-4316-b4b9-2e3e7753d4ce admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:29.637099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 159/315] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:29 2021] GET /identity/v3/roles/member => generated 84 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:29.644622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932006-630f-4a49-97da-1bf22bcbad4d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:29.662006 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c932006-630f-4a49-97da-1bf22bcbad4d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:29.676047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca27f4-59e8-4dee-80f6-debc78b5be69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:29.676741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca27f4-59e8-4dee-80f6-debc78b5be69 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.677024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca27f4-59e8-4dee-80f6-debc78b5be69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.677358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ca27f4-59e8-4dee-80f6-debc78b5be69 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.678157 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca27f4-59e8-4dee-80f6-debc78b5be69 admin admin] RBAC: Adding query filter params (name=member) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:29.678467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca27f4-59e8-4dee-80f6-debc78b5be69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:29.680139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ca27f4-59e8-4dee-80f6-debc78b5be69 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:29.695651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 157/316] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:29 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:29.702200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1b78-29b1-4316-b4b9-2e3e7753d4ce admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:29.719753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1b78-29b1-4316-b4b9-2e3e7753d4ce admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:29.730587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c9038-ed5b-4f06-bb12-be88cd595ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:29.731260 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c9038-ed5b-4f06-bb12-be88cd595ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.731542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c9038-ed5b-4f06-bb12-be88cd595ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.731822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824c9038-ed5b-4f06-bb12-be88cd595ab9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.749806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c9038-ed5b-4f06-bb12-be88cd595ab9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:29.751612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824c9038-ed5b-4f06-bb12-be88cd595ab9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:29.761846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 160/317] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:29 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:29.769340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca27f4-59e8-4dee-80f6-debc78b5be69 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:29.786434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ca27f4-59e8-4dee-80f6-debc78b5be69 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:29.794201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0d1e-c900-4de0-a166-680b643114e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:29.795059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0d1e-c900-4de0-a166-680b643114e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.795335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0d1e-c900-4de0-a166-680b643114e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.795704 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b0d1e-c900-4de0-a166-680b643114e2 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.800959 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b0d1e-c900-4de0-a166-680b643114e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:29.803070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b0d1e-c900-4de0-a166-680b643114e2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:29.804814 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 158/318] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:29 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:29.811289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c9038-ed5b-4f06-bb12-be88cd595ab9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:29.822899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824c9038-ed5b-4f06-bb12-be88cd595ab9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:29.830800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db523446-1956-4318-b683-0269b402bbcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:29.832370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db523446-1956-4318-b683-0269b402bbcb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.832654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db523446-1956-4318-b683-0269b402bbcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.832924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db523446-1956-4318-b683-0269b402bbcb admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.835359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db523446-1956-4318-b683-0269b402bbcb admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:29.837383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db523446-1956-4318-b683-0269b402bbcb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:29.839060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 161/319] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:29 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:29.845665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0d1e-c900-4de0-a166-680b643114e2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:29.859390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b0d1e-c900-4de0-a166-680b643114e2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:29.870376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aa1c2-8b48-4612-9a73-44c72b0ac2c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:29.871043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aa1c2-8b48-4612-9a73-44c72b0ac2c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.871315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aa1c2-8b48-4612-9a73-44c72b0ac2c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.871590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2aa1c2-8b48-4612-9a73-44c72b0ac2c9 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.872452 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aa1c2-8b48-4612-9a73-44c72b0ac2c9 admin admin] RBAC: Adding query filter params (group.id=110829c5a82e484cb2a67ff51f067241, role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:29.872783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aa1c2-8b48-4612-9a73-44c72b0ac2c9 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:29.874653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2aa1c2-8b48-4612-9a73-44c72b0ac2c9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:29.880888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6545b41-da7c-44d3-8f78-91f668c75ea0 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.881324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6545b41-da7c-44d3-8f78-91f668c75ea0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.881527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6545b41-da7c-44d3-8f78-91f668c75ea0 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.883932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 162/320] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:29.884181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 159/321] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:29 2021] GET /identity/v3/role_assignments?group.id=110829c5a82e484cb2a67ff51f067241&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 611 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:29.890091 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4679ba-aa2e-4a6c-ac4a-63b0d795294a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:29.890396 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4679ba-aa2e-4a6c-ac4a-63b0d795294a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:29.890641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4679ba-aa2e-4a6c-ac4a-63b0d795294a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:29.923214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-6e4679ba-aa2e-4a6c-ac4a-63b0d795294a None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:29.924443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-6e4679ba-aa2e-4a6c-ac4a-63b0d795294a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:29.934123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 163/322] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:29 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:29.993251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aa1c2-8b48-4612-9a73-44c72b0ac2c9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.009171 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2aa1c2-8b48-4612-9a73-44c72b0ac2c9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.020861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d354-d549-447d-81ef-662cfa8fb607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.021741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d354-d549-447d-81ef-662cfa8fb607 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.022050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d354-d549-447d-81ef-662cfa8fb607 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.022362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662d354-d549-447d-81ef-662cfa8fb607 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.038931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662d354-d549-447d-81ef-662cfa8fb607 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:30.046999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-1662d354-d549-447d-81ef-662cfa8fb607 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:30.054060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 160/323] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:29 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:30.055339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4679ba-aa2e-4a6c-ac4a-63b0d795294a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.068119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4679ba-aa2e-4a6c-ac4a-63b0d795294a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.077465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619270e5-53cd-46b8-b351-52dc4afc3d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.078200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619270e5-53cd-46b8-b351-52dc4afc3d05 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.078488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619270e5-53cd-46b8-b351-52dc4afc3d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.078801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619270e5-53cd-46b8-b351-52dc4afc3d05 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.079544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619270e5-53cd-46b8-b351-52dc4afc3d05 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:30.079851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619270e5-53cd-46b8-b351-52dc4afc3d05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.082119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619270e5-53cd-46b8-b351-52dc4afc3d05 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.093806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 164/324] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:30.102067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d354-d549-447d-81ef-662cfa8fb607 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.115812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662d354-d549-447d-81ef-662cfa8fb607 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.125406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441957b1-9413-4a64-b8e5-5ab778434fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.126098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441957b1-9413-4a64-b8e5-5ab778434fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.126380 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441957b1-9413-4a64-b8e5-5ab778434fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.126652 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441957b1-9413-4a64-b8e5-5ab778434fd1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.143280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441957b1-9413-4a64-b8e5-5ab778434fd1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.145672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441957b1-9413-4a64-b8e5-5ab778434fd1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.160148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 161/325] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:30.166431 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619270e5-53cd-46b8-b351-52dc4afc3d05 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.178151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619270e5-53cd-46b8-b351-52dc4afc3d05 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.184257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44d889-556e-4cef-bc48-dbabadb6f61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.185115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44d889-556e-4cef-bc48-dbabadb6f61f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.185391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44d889-556e-4cef-bc48-dbabadb6f61f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.185664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44d889-556e-4cef-bc48-dbabadb6f61f admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.187620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44d889-556e-4cef-bc48-dbabadb6f61f admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.189671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44d889-556e-4cef-bc48-dbabadb6f61f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.192445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 165/326] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:30.199320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441957b1-9413-4a64-b8e5-5ab778434fd1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.209748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441957b1-9413-4a64-b8e5-5ab778434fd1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.224821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721a3dec-f292-4bc1-8451-160f324ee902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.225744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a3dec-f292-4bc1-8451-160f324ee902 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.226054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a3dec-f292-4bc1-8451-160f324ee902 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.226337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721a3dec-f292-4bc1-8451-160f324ee902 admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.228320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a3dec-f292-4bc1-8451-160f324ee902 admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.230948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721a3dec-f292-4bc1-8451-160f324ee902 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.232089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 162/327] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:30.239406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44d889-556e-4cef-bc48-dbabadb6f61f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.251793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44d889-556e-4cef-bc48-dbabadb6f61f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.258995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe89e41-7e1a-4d21-b464-1e01cde28a86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.259753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89e41-7e1a-4d21-b464-1e01cde28a86 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.259977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89e41-7e1a-4d21-b464-1e01cde28a86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.260254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe89e41-7e1a-4d21-b464-1e01cde28a86 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.261139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe89e41-7e1a-4d21-b464-1e01cde28a86 admin admin] RBAC: Adding query filter params (group.id=110829c5a82e484cb2a67ff51f067241, role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=4d4f8cf5773f4074b83a335c1b11f025) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:30.261460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe89e41-7e1a-4d21-b464-1e01cde28a86 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.263479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe89e41-7e1a-4d21-b464-1e01cde28a86 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.274484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 166/328] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/role_assignments?group.id=110829c5a82e484cb2a67ff51f067241&scope.project.id=4d4f8cf5773f4074b83a335c1b11f025&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 611 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:30.588983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303489-5180-49cc-8b61-8127da67250d None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.589501 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303489-5180-49cc-8b61-8127da67250d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.589501 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5303489-5180-49cc-8b61-8127da67250d None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.591598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 163/329] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:30 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:30.597971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea99662-64ab-4b2f-8e64-7cab2b866628 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.598455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea99662-64ab-4b2f-8e64-7cab2b866628 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.598852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea99662-64ab-4b2f-8e64-7cab2b866628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.625415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-cea99662-64ab-4b2f-8e64-7cab2b866628 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:30.626661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-cea99662-64ab-4b2f-8e64-7cab2b866628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:30.637582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 167/330] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:30 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:30.663982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303489-5180-49cc-8b61-8127da67250d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.678057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5303489-5180-49cc-8b61-8127da67250d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.683254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153242a-36ac-4b55-8af8-2ade261f8c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.684039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153242a-36ac-4b55-8af8-2ade261f8c99 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.684311 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153242a-36ac-4b55-8af8-2ade261f8c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.684576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d153242a-36ac-4b55-8af8-2ade261f8c99 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.699629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d153242a-36ac-4b55-8af8-2ade261f8c99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:30.706542 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-d153242a-36ac-4b55-8af8-2ade261f8c99 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 27 01:00:30.708037 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 164/331] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/roles/member => generated 84 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:30.714155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea99662-64ab-4b2f-8e64-7cab2b866628 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.725619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea99662-64ab-4b2f-8e64-7cab2b866628 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.730436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89ad39-2884-4035-a340-e98a21f0035b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.731147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89ad39-2884-4035-a340-e98a21f0035b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.731423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89ad39-2884-4035-a340-e98a21f0035b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.731690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c89ad39-2884-4035-a340-e98a21f0035b admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.732450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89ad39-2884-4035-a340-e98a21f0035b admin admin] RBAC: Adding query filter params (name=member) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:30.732799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89ad39-2884-4035-a340-e98a21f0035b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.734477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c89ad39-2884-4035-a340-e98a21f0035b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.744278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 168/332] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/roles?name=member => generated 341 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:30.750474 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153242a-36ac-4b55-8af8-2ade261f8c99 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.761058 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d153242a-36ac-4b55-8af8-2ade261f8c99 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.765389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b7592-e957-4bd9-9c65-938ca46a1bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.766046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b7592-e957-4bd9-9c65-938ca46a1bed admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.766323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b7592-e957-4bd9-9c65-938ca46a1bed admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.766591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b7592-e957-4bd9-9c65-938ca46a1bed admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.776043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b7592-e957-4bd9-9c65-938ca46a1bed admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.777883 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b7592-e957-4bd9-9c65-938ca46a1bed admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.789043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 165/333] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:30.795464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89ad39-2884-4035-a340-e98a21f0035b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.805955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c89ad39-2884-4035-a340-e98a21f0035b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.812384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914597f-6d62-4c4d-93e8-8688cca0c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.813233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914597f-6d62-4c4d-93e8-8688cca0c938 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.813509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914597f-6d62-4c4d-93e8-8688cca0c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.813775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914597f-6d62-4c4d-93e8-8688cca0c938 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.815025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914597f-6d62-4c4d-93e8-8688cca0c938 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.817664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914597f-6d62-4c4d-93e8-8688cca0c938 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.820943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 169/334] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:30.827826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b7592-e957-4bd9-9c65-938ca46a1bed admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.837486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b7592-e957-4bd9-9c65-938ca46a1bed admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.845299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d11cc1-1931-4a28-a665-9b942248fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.846845 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d11cc1-1931-4a28-a665-9b942248fd15 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.846845 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d11cc1-1931-4a28-a665-9b942248fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.846845 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d11cc1-1931-4a28-a665-9b942248fd15 admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.848029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d11cc1-1931-4a28-a665-9b942248fd15 admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.849901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d11cc1-1931-4a28-a665-9b942248fd15 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.854087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 166/335] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:30.858157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914597f-6d62-4c4d-93e8-8688cca0c938 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:30.868289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914597f-6d62-4c4d-93e8-8688cca0c938 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:30.872897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe11c0f7-3914-4b0a-af0a-b179c638a44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:30.873668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11c0f7-3914-4b0a-af0a-b179c638a44d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:30.874019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11c0f7-3914-4b0a-af0a-b179c638a44d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:30.874395 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe11c0f7-3914-4b0a-af0a-b179c638a44d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:30.875365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11c0f7-3914-4b0a-af0a-b179c638a44d admin admin] RBAC: Adding query filter params (group.id=110829c5a82e484cb2a67ff51f067241, role.id=7800e44cf9cf448aa2ca1ae7e79fe128, scope.project.id=a767e19648dd4ee78d2439f37a731774) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:30.875757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11c0f7-3914-4b0a-af0a-b179c638a44d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:30.878337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe11c0f7-3914-4b0a-af0a-b179c638a44d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:30.885078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 170/336] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:30 2021] GET /identity/v3/role_assignments?group.id=110829c5a82e484cb2a67ff51f067241&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=7800e44cf9cf448aa2ca1ae7e79fe128 => generated 611 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:31.302045 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accedb6a-82ef-4f7c-af5e-b6a371f5ae1a None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.302324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accedb6a-82ef-4f7c-af5e-b6a371f5ae1a None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.302595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accedb6a-82ef-4f7c-af5e-b6a371f5ae1a None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.304367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 167/337] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:31.310350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2be7c-dd0e-4836-bafe-4e3f074197c4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.310728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2be7c-dd0e-4836-bafe-4e3f074197c4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.311070 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2be7c-dd0e-4836-bafe-4e3f074197c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.329268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9ac2be7c-dd0e-4836-bafe-4e3f074197c4 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:31.330452 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9ac2be7c-dd0e-4836-bafe-4e3f074197c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:31.337701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 171/338] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:31.361349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accedb6a-82ef-4f7c-af5e-b6a371f5ae1a None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:31.373547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accedb6a-82ef-4f7c-af5e-b6a371f5ae1a None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:31.377592 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe77a5-afd3-4424-b85b-f5599f1a74e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:31.379186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe77a5-afd3-4424-b85b-f5599f1a74e7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.379453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe77a5-afd3-4424-b85b-f5599f1a74e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.379717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fe77a5-afd3-4424-b85b-f5599f1a74e7 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.389451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fe77a5-afd3-4424-b85b-f5599f1a74e7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:31.396589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-77fe77a5-afd3-4424-b85b-f5599f1a74e7 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:31.397716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 168/339] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:31 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:31.404101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2be7c-dd0e-4836-bafe-4e3f074197c4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:31.413538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2be7c-dd0e-4836-bafe-4e3f074197c4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:31.417751 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523eac-b7fc-4795-a9ff-ce9c81cd7d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:31.418430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523eac-b7fc-4795-a9ff-ce9c81cd7d1b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.418704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523eac-b7fc-4795-a9ff-ce9c81cd7d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.418969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd523eac-b7fc-4795-a9ff-ce9c81cd7d1b admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.419745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd523eac-b7fc-4795-a9ff-ce9c81cd7d1b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:31.420044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd523eac-b7fc-4795-a9ff-ce9c81cd7d1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:31.421609 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd523eac-b7fc-4795-a9ff-ce9c81cd7d1b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:31.430046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 172/340] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:31 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:31.435892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe77a5-afd3-4424-b85b-f5599f1a74e7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:31.445866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fe77a5-afd3-4424-b85b-f5599f1a74e7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:31.450211 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ba3ad-d0c3-4ee6-a19c-0050212fa3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:31.450843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ba3ad-d0c3-4ee6-a19c-0050212fa3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.451127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ba3ad-d0c3-4ee6-a19c-0050212fa3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.451404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ba3ad-d0c3-4ee6-a19c-0050212fa3e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.460150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ba3ad-d0c3-4ee6-a19c-0050212fa3e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:31.461913 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ba3ad-d0c3-4ee6-a19c-0050212fa3e0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:31.470649 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 169/341] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:31 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:31.479489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523eac-b7fc-4795-a9ff-ce9c81cd7d1b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:31.489930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd523eac-b7fc-4795-a9ff-ce9c81cd7d1b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:31.494244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f583-37af-4db6-8349-589c6ebac624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:31.495085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f583-37af-4db6-8349-589c6ebac624 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.495366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f583-37af-4db6-8349-589c6ebac624 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.495641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c871f583-37af-4db6-8349-589c6ebac624 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.496836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871f583-37af-4db6-8349-589c6ebac624 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:31.498973 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c871f583-37af-4db6-8349-589c6ebac624 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:31.500743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 173/342] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:31 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:31.507683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ba3ad-d0c3-4ee6-a19c-0050212fa3e0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:31.516553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ba3ad-d0c3-4ee6-a19c-0050212fa3e0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:31.521050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2071a3f4-a029-4608-afd2-3d5d6b399b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:31.521871 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071a3f4-a029-4608-afd2-3d5d6b399b2e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.522178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071a3f4-a029-4608-afd2-3d5d6b399b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.522446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2071a3f4-a029-4608-afd2-3d5d6b399b2e admin admin] PATH_INFO: `/v3/groups/110829c5a82e484cb2a67ff51f067241` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.523865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071a3f4-a029-4608-afd2-3d5d6b399b2e admin admin] RBAC: Authorizing `identity:get_group(group_id=110829c5a82e484cb2a67ff51f067241)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:31.525721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2071a3f4-a029-4608-afd2-3d5d6b399b2e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:31.527335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 170/343] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:31 2021] GET /identity/v3/groups/110829c5a82e484cb2a67ff51f067241 => generated 226 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:31.533769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f583-37af-4db6-8349-589c6ebac624 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:31.544097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c871f583-37af-4db6-8349-589c6ebac624 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:31.548395 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccad29c-57b6-400a-a376-213ddce9ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:31.549023 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad29c-57b6-400a-a376-213ddce9ee32 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.549304 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad29c-57b6-400a-a376-213ddce9ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.549577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccad29c-57b6-400a-a376-213ddce9ee32 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.551238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccad29c-57b6-400a-a376-213ddce9ee32 admin admin] RBAC: Adding query filter params (group.id=110829c5a82e484cb2a67ff51f067241, role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=a767e19648dd4ee78d2439f37a731774) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:31.551547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccad29c-57b6-400a-a376-213ddce9ee32 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:31.553461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccad29c-57b6-400a-a376-213ddce9ee32 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:31.559348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 174/344] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:31 2021] GET /identity/v3/role_assignments?group.id=110829c5a82e484cb2a67ff51f067241&scope.project.id=a767e19648dd4ee78d2439f37a731774&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 611 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:31.895126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dfc37-d3fa-44e0-a1b2-da8e860fce00 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.895617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dfc37-d3fa-44e0-a1b2-da8e860fce00 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.895702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dfc37-d3fa-44e0-a1b2-da8e860fce00 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.897433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 171/345] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:31.903754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334173e2-7a06-4ad2-ad0e-8ac6806dcb64 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.904178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334173e2-7a06-4ad2-ad0e-8ac6806dcb64 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.904286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334173e2-7a06-4ad2-ad0e-8ac6806dcb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.922446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-334173e2-7a06-4ad2-ad0e-8ac6806dcb64 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:31.923618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-334173e2-7a06-4ad2-ad0e-8ac6806dcb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:31.931145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 175/346] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:31 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:31.955398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dfc37-d3fa-44e0-a1b2-da8e860fce00 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:31.967835 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dfc37-d3fa-44e0-a1b2-da8e860fce00 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:31.972493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d34785-918a-4d31-b90d-252c0f5b6331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:31.973257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d34785-918a-4d31-b90d-252c0f5b6331 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:31.973536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d34785-918a-4d31-b90d-252c0f5b6331 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:31.973810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d34785-918a-4d31-b90d-252c0f5b6331 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:31.983669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d34785-918a-4d31-b90d-252c0f5b6331 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:31.990512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-61d34785-918a-4d31-b90d-252c0f5b6331 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:31.991650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 172/347] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:31.997861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334173e2-7a06-4ad2-ad0e-8ac6806dcb64 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:32.006788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334173e2-7a06-4ad2-ad0e-8ac6806dcb64 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:32.011215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d81a8-6cbd-4379-b2f4-ec41dee12e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:32.011863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d81a8-6cbd-4379-b2f4-ec41dee12e4f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:32.012139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d81a8-6cbd-4379-b2f4-ec41dee12e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:32.012406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609d81a8-6cbd-4379-b2f4-ec41dee12e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:32.013153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d81a8-6cbd-4379-b2f4-ec41dee12e4f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:32.013447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d81a8-6cbd-4379-b2f4-ec41dee12e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:32.015063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609d81a8-6cbd-4379-b2f4-ec41dee12e4f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:32.024080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 176/348] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:32.029907 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d34785-918a-4d31-b90d-252c0f5b6331 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:32.039813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d34785-918a-4d31-b90d-252c0f5b6331 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:32.044034 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bb6cb-af45-4d2c-86c8-50debf272f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:32.044654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bb6cb-af45-4d2c-86c8-50debf272f14 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:32.044929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bb6cb-af45-4d2c-86c8-50debf272f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:32.045197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522bb6cb-af45-4d2c-86c8-50debf272f14 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:32.053130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bb6cb-af45-4d2c-86c8-50debf272f14 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:32.054879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522bb6cb-af45-4d2c-86c8-50debf272f14 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:32.063275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 173/349] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:32 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:32.069120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d81a8-6cbd-4379-b2f4-ec41dee12e4f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:32.078233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609d81a8-6cbd-4379-b2f4-ec41dee12e4f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:32.083042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdf3d0-7e0b-47cf-a4c1-4e64df72058d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:32.083851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdf3d0-7e0b-47cf-a4c1-4e64df72058d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:32.084127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdf3d0-7e0b-47cf-a4c1-4e64df72058d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:32.084394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fdf3d0-7e0b-47cf-a4c1-4e64df72058d admin admin] PATH_INFO: `/v3/projects/3355962a746e4ae38c08a8001aa0f51d` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:32.085534 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdf3d0-7e0b-47cf-a4c1-4e64df72058d admin admin] RBAC: Authorizing `identity:get_project(project_id=3355962a746e4ae38c08a8001aa0f51d)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:32.087302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fdf3d0-7e0b-47cf-a4c1-4e64df72058d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:32.088925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 177/350] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:00:32 2021] GET /identity/v3/projects/3355962a746e4ae38c08a8001aa0f51d => generated 344 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:32.094332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bb6cb-af45-4d2c-86c8-50debf272f14 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:32.103166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522bb6cb-af45-4d2c-86c8-50debf272f14 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:32.107352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0db868-08f2-4fc3-90ea-41bcc49639df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:32.108138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0db868-08f2-4fc3-90ea-41bcc49639df admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:32.108411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0db868-08f2-4fc3-90ea-41bcc49639df admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:32.108674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0db868-08f2-4fc3-90ea-41bcc49639df admin admin] PATH_INFO: `/v3/groups/ca47c19d3a94483e8acef5918300b09b` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:32.109794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0db868-08f2-4fc3-90ea-41bcc49639df admin admin] RBAC: Authorizing `identity:get_group(group_id=ca47c19d3a94483e8acef5918300b09b)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:32.111637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0db868-08f2-4fc3-90ea-41bcc49639df admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:32.113152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 174/351] 10.222.0.32 () {56 vars in 1201 bytes} [Wed Oct 27 01:00:32 2021] GET /identity/v3/groups/ca47c19d3a94483e8acef5918300b09b => generated 229 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:32.118841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdf3d0-7e0b-47cf-a4c1-4e64df72058d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:32.128443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fdf3d0-7e0b-47cf-a4c1-4e64df72058d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:32.132642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89821f-be8e-4dd0-8ed5-401142af6bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:32.133242 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89821f-be8e-4dd0-8ed5-401142af6bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:32.133521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89821f-be8e-4dd0-8ed5-401142af6bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:32.133789 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89821f-be8e-4dd0-8ed5-401142af6bd3 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:32.134645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89821f-be8e-4dd0-8ed5-401142af6bd3 admin admin] RBAC: Adding query filter params (group.id=ca47c19d3a94483e8acef5918300b09b, role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=3355962a746e4ae38c08a8001aa0f51d) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:32.134949 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89821f-be8e-4dd0-8ed5-401142af6bd3 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:32.136719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89821f-be8e-4dd0-8ed5-401142af6bd3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:32.142244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 178/352] 10.222.0.32 () {56 vars in 1397 bytes} [Wed Oct 27 01:00:32 2021] GET /identity/v3/role_assignments?group.id=ca47c19d3a94483e8acef5918300b09b&scope.project.id=3355962a746e4ae38c08a8001aa0f51d&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 611 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:35.014609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0d136-90e0-4856-a81f-12c615d0ede6 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.015147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0d136-90e0-4856-a81f-12c615d0ede6 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.015347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0d136-90e0-4856-a81f-12c615d0ede6 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.017564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 175/353] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:35.024694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523e25c-984d-45fa-b1a8-c312275e6f0c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.025159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523e25c-984d-45fa-b1a8-c312275e6f0c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.025259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523e25c-984d-45fa-b1a8-c312275e6f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.051443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-7523e25c-984d-45fa-b1a8-c312275e6f0c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:35.052616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7523e25c-984d-45fa-b1a8-c312275e6f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:35.065494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 179/354] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:35.094114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0d136-90e0-4856-a81f-12c615d0ede6 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.107472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0d136-90e0-4856-a81f-12c615d0ede6 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.112295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd24174-9940-437a-a75a-632512c30092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.113334 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd24174-9940-437a-a75a-632512c30092 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.113828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd24174-9940-437a-a75a-632512c30092 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.114324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd24174-9940-437a-a75a-632512c30092 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.125574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd24174-9940-437a-a75a-632512c30092 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.128295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd24174-9940-437a-a75a-632512c30092 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.149729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-1fd24174-9940-437a-a75a-632512c30092 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:35.151922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 176/355] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:35.158723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523e25c-984d-45fa-b1a8-c312275e6f0c None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.169380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523e25c-984d-45fa-b1a8-c312275e6f0c None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.175144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ab641-82e3-4b9b-901b-0852e6415167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.176188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ab641-82e3-4b9b-901b-0852e6415167 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.176671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ab641-82e3-4b9b-901b-0852e6415167 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.177154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ab641-82e3-4b9b-901b-0852e6415167 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.178133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ab641-82e3-4b9b-901b-0852e6415167 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:35.179953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55b92-0066-4749-99c5-d505fbc9566e None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.180469 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55b92-0066-4749-99c5-d505fbc9566e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.180972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d55b92-0066-4749-99c5-d505fbc9566e None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.183010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 177/356] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:35.183544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ab641-82e3-4b9b-901b-0852e6415167 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.185389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ab641-82e3-4b9b-901b-0852e6415167 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.189158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835d48a-e8d5-4cf8-abe6-a58230de7063 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.189662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835d48a-e8d5-4cf8-abe6-a58230de7063 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.190409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f835d48a-e8d5-4cf8-abe6-a58230de7063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.207591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 180/357] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:35.215203 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f835d48a-e8d5-4cf8-abe6-a58230de7063 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:35.216643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f835d48a-e8d5-4cf8-abe6-a58230de7063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:35.219289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ab641-82e3-4b9b-901b-0852e6415167 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.226707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 178/358] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:35.235968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ab641-82e3-4b9b-901b-0852e6415167 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.246162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cd738d-72aa-46c9-a38e-532f9e1aecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.246845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd738d-72aa-46c9-a38e-532f9e1aecc5 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.247120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd738d-72aa-46c9-a38e-532f9e1aecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.247389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd738d-72aa-46c9-a38e-532f9e1aecc5 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.248110 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd738d-72aa-46c9-a38e-532f9e1aecc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.250076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cd738d-72aa-46c9-a38e-532f9e1aecc5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.264753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835d48a-e8d5-4cf8-abe6-a58230de7063 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.277795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f835d48a-e8d5-4cf8-abe6-a58230de7063 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.287234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d92bf-d570-47e9-8964-e1ee2298b107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.293589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d92bf-d570-47e9-8964-e1ee2298b107 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.293589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d92bf-d570-47e9-8964-e1ee2298b107 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.293589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166d92bf-d570-47e9-8964-e1ee2298b107 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.304545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d92bf-d570-47e9-8964-e1ee2298b107 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.306780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166d92bf-d570-47e9-8964-e1ee2298b107 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.334606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-166d92bf-d570-47e9-8964-e1ee2298b107 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:35.338333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 179/359] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:35.342437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d92bf-d570-47e9-8964-e1ee2298b107 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.354949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166d92bf-d570-47e9-8964-e1ee2298b107 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.360705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.363716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.363716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.363716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.363716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:35.363716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.364389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_domains failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:35.364389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:35.364389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:35.365268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.388068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 181/360] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:00:35 2021] POST /identity/v3/users => generated 246 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:00:35.389628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525d69d-42c7-4e10-951f-db97b0815a7f None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.389910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525d69d-42c7-4e10-951f-db97b0815a7f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.390281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2525d69d-42c7-4e10-951f-db97b0815a7f None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.392123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 182/361] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:35.394324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 180/362] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:35.400606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.400749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402eb52-fe3d-477d-83ec-41bb21adca30 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.401013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402eb52-fe3d-477d-83ec-41bb21adca30 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.401287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402eb52-fe3d-477d-83ec-41bb21adca30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.414070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12100248-fb96-4512-bfa0-a1a1fc945a80 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.420015 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed52da-ed49-44a8-9b45-73d213541cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.420827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5402eb52-fe3d-477d-83ec-41bb21adca30 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:35.421333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed52da-ed49-44a8-9b45-73d213541cca admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.421834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed52da-ed49-44a8-9b45-73d213541cca admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.422133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5402eb52-fe3d-477d-83ec-41bb21adca30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:35.422590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed52da-ed49-44a8-9b45-73d213541cca admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.423714 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed52da-ed49-44a8-9b45-73d213541cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.426883 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ed52da-ed49-44a8-9b45-73d213541cca admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.431446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 183/363] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:35.460349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402eb52-fe3d-477d-83ec-41bb21adca30 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.470723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402eb52-fe3d-477d-83ec-41bb21adca30 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.476507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ee6a3-fe5f-4530-9e1b-f052e5da0243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.478285 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee6a3-fe5f-4530-9e1b-f052e5da0243 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.478673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee6a3-fe5f-4530-9e1b-f052e5da0243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.479004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17ee6a3-fe5f-4530-9e1b-f052e5da0243 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.492416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ee6a3-fe5f-4530-9e1b-f052e5da0243 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.494506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17ee6a3-fe5f-4530-9e1b-f052e5da0243 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.515453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-a17ee6a3-fe5f-4530-9e1b-f052e5da0243 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:35.521786 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 184/364] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:35.525773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ee6a3-fe5f-4530-9e1b-f052e5da0243 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.537467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17ee6a3-fe5f-4530-9e1b-f052e5da0243 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.542813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243fccb-2a27-4704-b4c3-ad30fbe96c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.543486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243fccb-2a27-4704-b4c3-ad30fbe96c39 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.543765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243fccb-2a27-4704-b4c3-ad30fbe96c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.544090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243fccb-2a27-4704-b4c3-ad30fbe96c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.544847 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243fccb-2a27-4704-b4c3-ad30fbe96c39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:35.545149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243fccb-2a27-4704-b4c3-ad30fbe96c39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.546964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243fccb-2a27-4704-b4c3-ad30fbe96c39 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.561974 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 181/365] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:00:35 2021] POST /identity/v3/users => generated 248 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:00:35.563296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 185/366] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:35.571089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243fccb-2a27-4704-b4c3-ad30fbe96c39 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.582849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243fccb-2a27-4704-b4c3-ad30fbe96c39 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.587703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58247883-b950-4635-b52e-160a1ed848cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.588430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58247883-b950-4635-b52e-160a1ed848cc admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.588716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58247883-b950-4635-b52e-160a1ed848cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.588987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58247883-b950-4635-b52e-160a1ed848cc admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.589759 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58247883-b950-4635-b52e-160a1ed848cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.591921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58247883-b950-4635-b52e-160a1ed848cc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.815394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2f53-42c5-4288-8d37-471d13debda4 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.815573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2f53-42c5-4288-8d37-471d13debda4 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.815847 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6b2f53-42c5-4288-8d37-471d13debda4 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.817865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 182/367] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:35 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:35.824449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc783e8f-90c2-4422-b8bf-fdae853230d6 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.824728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc783e8f-90c2-4422-b8bf-fdae853230d6 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.825006 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc783e8f-90c2-4422-b8bf-fdae853230d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.844700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-cc783e8f-90c2-4422-b8bf-fdae853230d6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:35.847078 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-cc783e8f-90c2-4422-b8bf-fdae853230d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:35.854606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 183/368] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:35 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:35.880701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 186/369] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:00:35 2021] POST /identity/v3/users => generated 248 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:00:35.885395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc783e8f-90c2-4422-b8bf-fdae853230d6 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.896511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc783e8f-90c2-4422-b8bf-fdae853230d6 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.902084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730d49-d23b-411d-a73f-2935a344e17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.902966 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730d49-d23b-411d-a73f-2935a344e17e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.903248 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730d49-d23b-411d-a73f-2935a344e17e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.903517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b730d49-d23b-411d-a73f-2935a344e17e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.915744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b730d49-d23b-411d-a73f-2935a344e17e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.917680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b730d49-d23b-411d-a73f-2935a344e17e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:35.937645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-8b730d49-d23b-411d-a73f-2935a344e17e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:35.939345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 184/370] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:35 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:35.946782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58247883-b950-4635-b52e-160a1ed848cc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:35.968951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58247883-b950-4635-b52e-160a1ed848cc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:35.982839 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53811343-4719-4058-8d26-ef6902a0b767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:35.983804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811343-4719-4058-8d26-ef6902a0b767 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:35.984315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811343-4719-4058-8d26-ef6902a0b767 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:35.984722 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53811343-4719-4058-8d26-ef6902a0b767 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:35.985630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53811343-4719-4058-8d26-ef6902a0b767 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:35.986130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53811343-4719-4058-8d26-ef6902a0b767 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:35.988168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53811343-4719-4058-8d26-ef6902a0b767 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:36.006898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 187/371] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:36.013365 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730d49-d23b-411d-a73f-2935a344e17e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:36.027527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b730d49-d23b-411d-a73f-2935a344e17e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:36.036036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8a6621-bc34-4251-b063-32a0f26e848d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:36.036720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a6621-bc34-4251-b063-32a0f26e848d admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:36.037042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a6621-bc34-4251-b063-32a0f26e848d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:36.037357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8a6621-bc34-4251-b063-32a0f26e848d admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:36.038114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a6621-bc34-4251-b063-32a0f26e848d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:36.040210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8a6621-bc34-4251-b063-32a0f26e848d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:36.172119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 185/372] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:00:36 2021] POST /identity/v3/users => generated 249 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:00:36.717636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab1a00-f7b2-4b72-bfac-c344a420bf09 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:36.718206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab1a00-f7b2-4b72-bfac-c344a420bf09 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:36.718206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fab1a00-f7b2-4b72-bfac-c344a420bf09 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:36.720100 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 188/373] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:36 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:36.726827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11ee7-e784-440f-b0ee-2a847483074d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:36.727361 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11ee7-e784-440f-b0ee-2a847483074d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:36.727827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a11ee7-e784-440f-b0ee-2a847483074d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:36.748497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-49a11ee7-e784-440f-b0ee-2a847483074d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:36.749995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-49a11ee7-e784-440f-b0ee-2a847483074d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:36.762220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 186/374] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:36 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:36.783145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab1a00-f7b2-4b72-bfac-c344a420bf09 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:36.796688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fab1a00-f7b2-4b72-bfac-c344a420bf09 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:36.802185 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:36.803065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:36.803550 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:36.804032 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:36.805002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] RBAC: Authorizing `identity:create_role()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:36.806801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:36.845259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.sql.core [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 27 01:00:36.845259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 27 01:00:36.845259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [parameters: {'id': '6eff779f1a9b4b129e71e8f93fd72804', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 27 01:00:36.845259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79889) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:00:36.859663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 27 01:00:36.861417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 189/375] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:00:36 2021] POST /identity/v3/roles => generated 144 bytes in 79 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:36.867972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a11ee7-e784-440f-b0ee-2a847483074d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:36.879889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a11ee7-e784-440f-b0ee-2a847483074d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:36.885622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f5b92-4229-4794-b700-e5596ce3f57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:36.886503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f5b92-4229-4794-b700-e5596ce3f57a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:36.886774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f5b92-4229-4794-b700-e5596ce3f57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:36.887041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f5b92-4229-4794-b700-e5596ce3f57a admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:36.902179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f5b92-4229-4794-b700-e5596ce3f57a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:36.909520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-613f5b92-4229-4794-b700-e5596ce3f57a admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 27 01:00:36.911187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 187/376] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:00:36 2021] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:36.917269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:36.931106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d59a12-3140-498b-9ea6-9d1f43e51c4d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:36.943012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297f9e3e-352e-4225-8b0d-9a1d5046c113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:36.944076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f9e3e-352e-4225-8b0d-9a1d5046c113 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:36.944605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f9e3e-352e-4225-8b0d-9a1d5046c113 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:36.945083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f9e3e-352e-4225-8b0d-9a1d5046c113 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:36.946073 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f9e3e-352e-4225-8b0d-9a1d5046c113 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:36.946591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f9e3e-352e-4225-8b0d-9a1d5046c113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:36.948388 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297f9e3e-352e-4225-8b0d-9a1d5046c113 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:36.963399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 190/377] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:36 2021] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:38.049377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef5acb-8f00-4f8b-8521-33be214bd590 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.050072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef5acb-8f00-4f8b-8521-33be214bd590 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.050072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef5acb-8f00-4f8b-8521-33be214bd590 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.052004 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 188/378] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:38.058515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e7634-8e1a-4dc0-8ce3-88d2a7b82c7d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.058928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e7634-8e1a-4dc0-8ce3-88d2a7b82c7d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.059111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e7634-8e1a-4dc0-8ce3-88d2a7b82c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.084283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-819e7634-8e1a-4dc0-8ce3-88d2a7b82c7d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:38.085494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-819e7634-8e1a-4dc0-8ce3-88d2a7b82c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:38.102456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 191/379] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:38.150114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef5acb-8f00-4f8b-8521-33be214bd590 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.169396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ef5acb-8f00-4f8b-8521-33be214bd590 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.174098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930caa09-d6a2-46a6-a0dd-5d9c0dd52a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.175544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930caa09-d6a2-46a6-a0dd-5d9c0dd52a12 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.175820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930caa09-d6a2-46a6-a0dd-5d9c0dd52a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.176088 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930caa09-d6a2-46a6-a0dd-5d9c0dd52a12 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.198971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930caa09-d6a2-46a6-a0dd-5d9c0dd52a12 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:38.206133 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-930caa09-d6a2-46a6-a0dd-5d9c0dd52a12 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:38.207720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 189/380] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:38.213802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e7634-8e1a-4dc0-8ce3-88d2a7b82c7d None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.227143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e7634-8e1a-4dc0-8ce3-88d2a7b82c7d None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.238673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad68769-d8ea-4de8-98d2-757ea00ffe7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.239522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68769-d8ea-4de8-98d2-757ea00ffe7c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.239806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68769-d8ea-4de8-98d2-757ea00ffe7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.240081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad68769-d8ea-4de8-98d2-757ea00ffe7c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.240854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68769-d8ea-4de8-98d2-757ea00ffe7c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:38.241159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68769-d8ea-4de8-98d2-757ea00ffe7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.242847 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad68769-d8ea-4de8-98d2-757ea00ffe7c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.256734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 192/381] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:38.263114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930caa09-d6a2-46a6-a0dd-5d9c0dd52a12 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.276830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930caa09-d6a2-46a6-a0dd-5d9c0dd52a12 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.291017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04818896-34d8-457a-ab70-6ab5441d60d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.291846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04818896-34d8-457a-ab70-6ab5441d60d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.292124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04818896-34d8-457a-ab70-6ab5441d60d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.292396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04818896-34d8-457a-ab70-6ab5441d60d2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.310623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04818896-34d8-457a-ab70-6ab5441d60d2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.312505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04818896-34d8-457a-ab70-6ab5441d60d2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.340827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-04818896-34d8-457a-ab70-6ab5441d60d2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:38.342056 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 190/382] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 79 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:38.348465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad68769-d8ea-4de8-98d2-757ea00ffe7c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.376559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad68769-d8ea-4de8-98d2-757ea00ffe7c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.392063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b9562b-1690-4f0c-a8ae-2045ea5f82ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.393891 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9562b-1690-4f0c-a8ae-2045ea5f82ce admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.394393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9562b-1690-4f0c-a8ae-2045ea5f82ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.394856 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b9562b-1690-4f0c-a8ae-2045ea5f82ce admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.395820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9562b-1690-4f0c-a8ae-2045ea5f82ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:38.396334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9562b-1690-4f0c-a8ae-2045ea5f82ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.398375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b9562b-1690-4f0c-a8ae-2045ea5f82ce admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.420300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 193/383] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:38.426615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04818896-34d8-457a-ab70-6ab5441d60d2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.435982 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc233486-bf98-4837-9d4c-de46914d5e94 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.436264 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc233486-bf98-4837-9d4c-de46914d5e94 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.436554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc233486-bf98-4837-9d4c-de46914d5e94 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.444333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04818896-34d8-457a-ab70-6ab5441d60d2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.446303 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 194/384] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:38 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:38.447607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6bcb-0622-4b2f-920b-4184e9236e42 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.447887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6bcb-0622-4b2f-920b-4184e9236e42 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.448161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda6bcb-0622-4b2f-920b-4184e9236e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.451188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd0ca2-0740-4ae6-86fe-51d71878a325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.453340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd0ca2-0740-4ae6-86fe-51d71878a325 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.453625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd0ca2-0740-4ae6-86fe-51d71878a325 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.454897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fd0ca2-0740-4ae6-86fe-51d71878a325 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.473988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd0ca2-0740-4ae6-86fe-51d71878a325 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.476056 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fd0ca2-0740-4ae6-86fe-51d71878a325 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.486050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-6eda6bcb-0622-4b2f-920b-4184e9236e42 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:38.486050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-6eda6bcb-0622-4b2f-920b-4184e9236e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:38.504981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-58fd0ca2-0740-4ae6-86fe-51d71878a325 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:00:38.505313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 195/385] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:38.510104 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 191/386] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/users/nova => generated 82 bytes in 81 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:38.519860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6bcb-0622-4b2f-920b-4184e9236e42 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.529898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda6bcb-0622-4b2f-920b-4184e9236e42 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.532990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd0ca2-0740-4ae6-86fe-51d71878a325 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.543812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fd0ca2-0740-4ae6-86fe-51d71878a325 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.547979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.548658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.548936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.549802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.550624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:38.550930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.551951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:38.551951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:00:38.551951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:00:38.553065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.564531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d84c9-be68-4c93-a9d3-ec3147b1e9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.565894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d84c9-be68-4c93-a9d3-ec3147b1e9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.566212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d84c9-be68-4c93-a9d3-ec3147b1e9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.566480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d84c9-be68-4c93-a9d3-ec3147b1e9f0 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.603154 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d84c9-be68-4c93-a9d3-ec3147b1e9f0 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:38.614050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 196/387] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:38.616392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-f02d84c9-be68-4c93-a9d3-ec3147b1e9f0 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:38.618061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 192/388] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/roles/service => generated 85 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:38.622997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.628095 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d84c9-be68-4c93-a9d3-ec3147b1e9f0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.649871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f5e85-5bae-4670-9075-059e33ea1c34 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.659399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d84c9-be68-4c93-a9d3-ec3147b1e9f0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.676616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd22b96-4f55-4808-98c8-091144f3dc77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.678450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd22b96-4f55-4808-98c8-091144f3dc77 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.678450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd22b96-4f55-4808-98c8-091144f3dc77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.678450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd22b96-4f55-4808-98c8-091144f3dc77 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.686051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa781885-15ef-406d-a530-e150d8319d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.686051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa781885-15ef-406d-a530-e150d8319d76 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.686051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa781885-15ef-406d-a530-e150d8319d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.686051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa781885-15ef-406d-a530-e150d8319d76 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.690497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa781885-15ef-406d-a530-e150d8319d76 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:38.690497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa781885-15ef-406d-a530-e150d8319d76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.692930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa781885-15ef-406d-a530-e150d8319d76 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.714057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd22b96-4f55-4808-98c8-091144f3dc77 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.714057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd22b96-4f55-4808-98c8-091144f3dc77 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.724433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 193/389] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:38.733258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa781885-15ef-406d-a530-e150d8319d76 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.744610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 197/390] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:38.750047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa781885-15ef-406d-a530-e150d8319d76 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.755313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd22b96-4f55-4808-98c8-091144f3dc77 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.772803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd22b96-4f55-4808-98c8-091144f3dc77 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.777038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3369a-5c41-45a3-bed4-1c83d9bfd465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.779853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3369a-5c41-45a3-bed4-1c83d9bfd465 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.782283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3369a-5c41-45a3-bed4-1c83d9bfd465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.782794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c3369a-5c41-45a3-bed4-1c83d9bfd465 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.785194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5479233-6aad-4c2e-9d09-45332280ef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.787369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5479233-6aad-4c2e-9d09-45332280ef3c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.787660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5479233-6aad-4c2e-9d09-45332280ef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.787934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5479233-6aad-4c2e-9d09-45332280ef3c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.805906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3369a-5c41-45a3-bed4-1c83d9bfd465 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.808185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c3369a-5c41-45a3-bed4-1c83d9bfd465 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.820908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5479233-6aad-4c2e-9d09-45332280ef3c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.822821 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5479233-6aad-4c2e-9d09-45332280ef3c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.827354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-c5c3369a-5c41-45a3-bed4-1c83d9bfd465 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:38.828747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 194/391] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 96 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:38.839519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3369a-5c41-45a3-bed4-1c83d9bfd465 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.855404 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-d5479233-6aad-4c2e-9d09-45332280ef3c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:38.856921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 198/392] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:38.860193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c3369a-5c41-45a3-bed4-1c83d9bfd465 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.863908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5479233-6aad-4c2e-9d09-45332280ef3c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.873753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523647c6-f30a-40b8-b555-e16f3d3a7399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.874487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523647c6-f30a-40b8-b555-e16f3d3a7399 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.874763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523647c6-f30a-40b8-b555-e16f3d3a7399 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.875034 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523647c6-f30a-40b8-b555-e16f3d3a7399 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.876190 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523647c6-f30a-40b8-b555-e16f3d3a7399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:38.876490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523647c6-f30a-40b8-b555-e16f3d3a7399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.881162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5479233-6aad-4c2e-9d09-45332280ef3c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.882269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523647c6-f30a-40b8-b555-e16f3d3a7399 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.890967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52693c-5b02-48ef-b4de-eafad4579981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.891748 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52693c-5b02-48ef-b4de-eafad4579981 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.892032 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52693c-5b02-48ef-b4de-eafad4579981 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.892307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52693c-5b02-48ef-b4de-eafad4579981 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.894525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52693c-5b02-48ef-b4de-eafad4579981 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:38.894868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52693c-5b02-48ef-b4de-eafad4579981 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.896526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52693c-5b02-48ef-b4de-eafad4579981 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.902155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 195/393] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:38.908421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523647c6-f30a-40b8-b555-e16f3d3a7399 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.920344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523647c6-f30a-40b8-b555-e16f3d3a7399 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.923987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 199/394] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:38.926353 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f2046-b753-4f2a-8466-5cd5cb9989c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.927418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2046-b753-4f2a-8466-5cd5cb9989c7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.927896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2046-b753-4f2a-8466-5cd5cb9989c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.928388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f2046-b753-4f2a-8466-5cd5cb9989c7 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.931290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52693c-5b02-48ef-b4de-eafad4579981 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.937505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f2046-b753-4f2a-8466-5cd5cb9989c7 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.940636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f2046-b753-4f2a-8466-5cd5cb9989c7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.941430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52693c-5b02-48ef-b4de-eafad4579981 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.950311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884b392f-7958-4541-8847-50ba942f8f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.951101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b392f-7958-4541-8847-50ba942f8f97 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.951379 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b392f-7958-4541-8847-50ba942f8f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.951647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884b392f-7958-4541-8847-50ba942f8f97 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.956873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-d31f2046-b753-4f2a-8466-5cd5cb9989c7 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:00:38.958355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 196/395] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/users/cinder => generated 84 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:38.959617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b392f-7958-4541-8847-50ba942f8f97 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:38.964944 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471a72d-9eac-4f2e-975e-f9554c34201d None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.965078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884b392f-7958-4541-8847-50ba942f8f97 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:38.965720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471a72d-9eac-4f2e-975e-f9554c34201d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.966255 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471a72d-9eac-4f2e-975e-f9554c34201d None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.968284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 197/396] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:38 2021] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:38.969244 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471a72d-9eac-4f2e-975e-f9554c34201d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:38.980364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-884b392f-7958-4541-8847-50ba942f8f97 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:38.981882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 200/397] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:38.983161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157145-4493-4c68-82b0-e5adf27f00e1 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.983445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157145-4493-4c68-82b0-e5adf27f00e1 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.983712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2157145-4493-4c68-82b0-e5adf27f00e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:38.985753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471a72d-9eac-4f2e-975e-f9554c34201d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:38.997010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:38.998001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:38.998711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:38.999223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.000333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.000840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.002232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_users failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:39.002232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:39.002232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:39.004392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.007332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b2157145-4493-4c68-82b0-e5adf27f00e1 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:39.008507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b2157145-4493-4c68-82b0-e5adf27f00e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:39.016883 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 201/398] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:38 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:39.017790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157145-4493-4c68-82b0-e5adf27f00e1 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.027961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2157145-4493-4c68-82b0-e5adf27f00e1 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.041510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.042211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.042494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.042771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.043581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.043887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.044902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:39.044902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:00:39.044902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:00:39.046050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.050712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 198/399] 10.222.0.32 () {56 vars in 1158 bytes} [Wed Oct 27 01:00:38 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.057260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.068537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f970ee9-0dac-4801-a1cc-1d40b9bd3ce2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.073238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 202/400] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.074373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9913e2-b84f-45b1-9921-cdac7b4859ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.075260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9913e2-b84f-45b1-9921-cdac7b4859ea admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.075790 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9913e2-b84f-45b1-9921-cdac7b4859ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.076275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9913e2-b84f-45b1-9921-cdac7b4859ea admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.079396 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.086571 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9913e2-b84f-45b1-9921-cdac7b4859ea admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.088638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9913e2-b84f-45b1-9921-cdac7b4859ea admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.089604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809fb1b0-6b8c-4a9d-b8b6-df1b45bb1caf admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.094064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653361f5-1228-4f2b-8856-6c6f60bd2938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.094919 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653361f5-1228-4f2b-8856-6c6f60bd2938 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.095201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653361f5-1228-4f2b-8856-6c6f60bd2938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.095468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653361f5-1228-4f2b-8856-6c6f60bd2938 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.101337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 199/401] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:00:39.106205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9913e2-b84f-45b1-9921-cdac7b4859ea admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.106426 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653361f5-1228-4f2b-8856-6c6f60bd2938 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:39.113708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-653361f5-1228-4f2b-8856-6c6f60bd2938 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:39.117120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9913e2-b84f-45b1-9921-cdac7b4859ea admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.120204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 203/402] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:39.121025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653361f5-1228-4f2b-8856-6c6f60bd2938 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.122697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5d9f0-8f58-48ed-b0e0-ebebfade2e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.123579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5d9f0-8f58-48ed-b0e0-ebebfade2e0b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.124060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5d9f0-8f58-48ed-b0e0-ebebfade2e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.124531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5d9f0-8f58-48ed-b0e0-ebebfade2e0b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.125562 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5d9f0-8f58-48ed-b0e0-ebebfade2e0b admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=d1596a916d784f6bb6e3b876f4820903) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.126136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5d9f0-8f58-48ed-b0e0-ebebfade2e0b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.128690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5d9f0-8f58-48ed-b0e0-ebebfade2e0b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.131234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653361f5-1228-4f2b-8856-6c6f60bd2938 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.135599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414af080-238c-471f-8b0c-45fb5e65c656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.136052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 200/403] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/role_assignments?user.id=d1596a916d784f6bb6e3b876f4820903&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.137082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5d9f0-8f58-48ed-b0e0-ebebfade2e0b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.142600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af080-238c-471f-8b0c-45fb5e65c656 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.142889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af080-238c-471f-8b0c-45fb5e65c656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.143766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414af080-238c-471f-8b0c-45fb5e65c656 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.149303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5d9f0-8f58-48ed-b0e0-ebebfade2e0b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.154662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877afd4-a50d-46a1-a5ed-8eda71427e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.155625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877afd4-a50d-46a1-a5ed-8eda71427e41 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.156141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877afd4-a50d-46a1-a5ed-8eda71427e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.156610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877afd4-a50d-46a1-a5ed-8eda71427e41 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.157631 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877afd4-a50d-46a1-a5ed-8eda71427e41 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.158209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877afd4-a50d-46a1-a5ed-8eda71427e41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.160197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877afd4-a50d-46a1-a5ed-8eda71427e41 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.171038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414af080-238c-471f-8b0c-45fb5e65c656 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.173808 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414af080-238c-471f-8b0c-45fb5e65c656 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.178582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 201/404] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.183648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877afd4-a50d-46a1-a5ed-8eda71427e41 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.200347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877afd4-a50d-46a1-a5ed-8eda71427e41 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.214327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999724bd-dcd5-462d-bb51-c4fc3da18fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.215588 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999724bd-dcd5-462d-bb51-c4fc3da18fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.216165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-414af080-238c-471f-8b0c-45fb5e65c656 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:39.217068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999724bd-dcd5-462d-bb51-c4fc3da18fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.218155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999724bd-dcd5-462d-bb51-c4fc3da18fa9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.219662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 204/405] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 99 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:39.233169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414af080-238c-471f-8b0c-45fb5e65c656 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.243864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999724bd-dcd5-462d-bb51-c4fc3da18fa9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.246523 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414af080-238c-471f-8b0c-45fb5e65c656 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.248764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999724bd-dcd5-462d-bb51-c4fc3da18fa9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.257962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe729a30-f8ce-4ff0-882e-4e0718a71cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.260721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe729a30-f8ce-4ff0-882e-4e0718a71cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.261246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe729a30-f8ce-4ff0-882e-4e0718a71cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.262276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe729a30-f8ce-4ff0-882e-4e0718a71cf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.263238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe729a30-f8ce-4ff0-882e-4e0718a71cf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.264556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe729a30-f8ce-4ff0-882e-4e0718a71cf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.267014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe729a30-f8ce-4ff0-882e-4e0718a71cf4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.289333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-999724bd-dcd5-462d-bb51-c4fc3da18fa9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:39.294527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 202/406] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 109 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:39.295037 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 205/407] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:39.300746 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999724bd-dcd5-462d-bb51-c4fc3da18fa9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.308458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe729a30-f8ce-4ff0-882e-4e0718a71cf4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.322634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe729a30-f8ce-4ff0-882e-4e0718a71cf4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.324031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999724bd-dcd5-462d-bb51-c4fc3da18fa9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.333637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bc436-5cb5-43f9-a4e4-9be49893d435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.334581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a130841-6820-407f-abd7-4e4b652b9857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.334741 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc436-5cb5-43f9-a4e4-9be49893d435 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.335125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc436-5cb5-43f9-a4e4-9be49893d435 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.335495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bc436-5cb5-43f9-a4e4-9be49893d435 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.335909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a130841-6820-407f-abd7-4e4b652b9857 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.336328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a130841-6820-407f-abd7-4e4b652b9857 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.336778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a130841-6820-407f-abd7-4e4b652b9857 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.337685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a130841-6820-407f-abd7-4e4b652b9857 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.338176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a130841-6820-407f-abd7-4e4b652b9857 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.340254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a130841-6820-407f-abd7-4e4b652b9857 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.344550 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bc436-5cb5-43f9-a4e4-9be49893d435 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.346777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bc436-5cb5-43f9-a4e4-9be49893d435 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.355279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 203/408] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.356881 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dacb3-ba79-440c-9dc6-ea378d63b6e3 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.357301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dacb3-ba79-440c-9dc6-ea378d63b6e3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.357706 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dacb3-ba79-440c-9dc6-ea378d63b6e3 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.359529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 204/409] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:39.363895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-844bc436-5cb5-43f9-a4e4-9be49893d435 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:39.364957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dacb3-ba79-440c-9dc6-ea378d63b6e3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.366425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 206/410] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:39.371612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad5eb6-b403-4839-9dde-004dae087be4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.372002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad5eb6-b403-4839-9dde-004dae087be4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.372376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad5eb6-b403-4839-9dde-004dae087be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.382064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dacb3-ba79-440c-9dc6-ea378d63b6e3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.386688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a2ec-b700-4bd5-b353-53b1d844baed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.387685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a2ec-b700-4bd5-b353-53b1d844baed admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.388121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a2ec-b700-4bd5-b353-53b1d844baed admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.388602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a8a2ec-b700-4bd5-b353-53b1d844baed admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.395400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-7fad5eb6-b403-4839-9dde-004dae087be4 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:39.396622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7fad5eb6-b403-4839-9dde-004dae087be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:39.396948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8a2ec-b700-4bd5-b353-53b1d844baed admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.399386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a8a2ec-b700-4bd5-b353-53b1d844baed admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.405471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 207/411] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:39 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:39.406312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad5eb6-b403-4839-9dde-004dae087be4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.421984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-95a8a2ec-b700-4bd5-b353-53b1d844baed admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:00:39.425312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 205/412] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/users/glance => generated 84 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:39.431658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a2ec-b700-4bd5-b353-53b1d844baed admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.431957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad5eb6-b403-4839-9dde-004dae087be4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.436481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a9d5a-25da-4574-9662-8d03ecf2fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.437145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a9d5a-25da-4574-9662-8d03ecf2fe64 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.437421 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a9d5a-25da-4574-9662-8d03ecf2fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.437698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a9d5a-25da-4574-9662-8d03ecf2fe64 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.438527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a9d5a-25da-4574-9662-8d03ecf2fe64 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.438835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a9d5a-25da-4574-9662-8d03ecf2fe64 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.441439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a9d5a-25da-4574-9662-8d03ecf2fe64 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.443620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a8a2ec-b700-4bd5-b353-53b1d844baed admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.448530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e02a9b-733e-461a-bdf4-89e1105151f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.449397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e02a9b-733e-461a-bdf4-89e1105151f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.449719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e02a9b-733e-461a-bdf4-89e1105151f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.450257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e02a9b-733e-461a-bdf4-89e1105151f4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.454552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 208/413] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.455573 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a9d5a-25da-4574-9662-8d03ecf2fe64 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.462116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e02a9b-733e-461a-bdf4-89e1105151f4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:39.469524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-38e02a9b-733e-461a-bdf4-89e1105151f4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:39.470622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a9d5a-25da-4574-9662-8d03ecf2fe64 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.471406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 206/414] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:39.472299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e02a9b-733e-461a-bdf4-89e1105151f4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.475678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74e18-55a7-43d8-9d1c-ad3140362681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.476584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74e18-55a7-43d8-9d1c-ad3140362681 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.477057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74e18-55a7-43d8-9d1c-ad3140362681 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.477476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74e18-55a7-43d8-9d1c-ad3140362681 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.478780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e74e18-55a7-43d8-9d1c-ad3140362681 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.479251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e74e18-55a7-43d8-9d1c-ad3140362681 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.481379 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e74e18-55a7-43d8-9d1c-ad3140362681 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.489785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e02a9b-733e-461a-bdf4-89e1105151f4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.494265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595c7e9-206a-4d5c-80c7-dc3ab01bb69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.494901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595c7e9-206a-4d5c-80c7-dc3ab01bb69e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.495177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595c7e9-206a-4d5c-80c7-dc3ab01bb69e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.495447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c595c7e9-206a-4d5c-80c7-dc3ab01bb69e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.496496 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595c7e9-206a-4d5c-80c7-dc3ab01bb69e admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=6d490db0d91a4426930130a4f83f7bc7) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.496801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595c7e9-206a-4d5c-80c7-dc3ab01bb69e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.498640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c595c7e9-206a-4d5c-80c7-dc3ab01bb69e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.504440 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 209/415] 10.222.0.32 () {56 vars in 1158 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.504440 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74e18-55a7-43d8-9d1c-ad3140362681 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.507283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 207/416] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/role_assignments?user.id=6d490db0d91a4426930130a4f83f7bc7&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.512646 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595c7e9-206a-4d5c-80c7-dc3ab01bb69e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.524794 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e74e18-55a7-43d8-9d1c-ad3140362681 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.538366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb31aa-ed05-491e-b8e3-eb22e543daa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.539295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb31aa-ed05-491e-b8e3-eb22e543daa2 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.539755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb31aa-ed05-491e-b8e3-eb22e543daa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.540829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb31aa-ed05-491e-b8e3-eb22e543daa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.541916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb31aa-ed05-491e-b8e3-eb22e543daa2 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.542629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb31aa-ed05-491e-b8e3-eb22e543daa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.544501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fb31aa-ed05-491e-b8e3-eb22e543daa2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.544839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c595c7e9-206a-4d5c-80c7-dc3ab01bb69e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.555770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 210/417] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.558107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6101f16-90d6-4801-8926-64b03466b70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.558916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6101f16-90d6-4801-8926-64b03466b70a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.559287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6101f16-90d6-4801-8926-64b03466b70a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.559697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6101f16-90d6-4801-8926-64b03466b70a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.561526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb31aa-ed05-491e-b8e3-eb22e543daa2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.580747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fb31aa-ed05-491e-b8e3-eb22e543daa2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.583732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6101f16-90d6-4801-8926-64b03466b70a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.588044 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6101f16-90d6-4801-8926-64b03466b70a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.590258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc4ad4-5837-4591-adba-698d062f47ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.591618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc4ad4-5837-4591-adba-698d062f47ba admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.593511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc4ad4-5837-4591-adba-698d062f47ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.593945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fc4ad4-5837-4591-adba-698d062f47ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.610556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 208/418] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:39.618804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc4ad4-5837-4591-adba-698d062f47ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.620916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fc4ad4-5837-4591-adba-698d062f47ba admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.630658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6101f16-90d6-4801-8926-64b03466b70a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.644340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-81fc4ad4-5837-4591-adba-698d062f47ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:39.645923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 211/419] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:39.648844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6101f16-90d6-4801-8926-64b03466b70a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.652093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc4ad4-5837-4591-adba-698d062f47ba admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.664429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fc4ad4-5837-4591-adba-698d062f47ba admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.665985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05ebb5-236d-40c2-8a58-74b631e39380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.667003 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ebb5-236d-40c2-8a58-74b631e39380 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.667431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ebb5-236d-40c2-8a58-74b631e39380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.667857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05ebb5-236d-40c2-8a58-74b631e39380 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.669726 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6355e6-3893-4560-a747-199f23ebe5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.670700 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6355e6-3893-4560-a747-199f23ebe5bf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.671106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6355e6-3893-4560-a747-199f23ebe5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.671482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6355e6-3893-4560-a747-199f23ebe5bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.672402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6355e6-3893-4560-a747-199f23ebe5bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.673020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6355e6-3893-4560-a747-199f23ebe5bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.676289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6355e6-3893-4560-a747-199f23ebe5bf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.691297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 212/420] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.692752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05ebb5-236d-40c2-8a58-74b631e39380 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.694749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05ebb5-236d-40c2-8a58-74b631e39380 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.696850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6355e6-3893-4560-a747-199f23ebe5bf admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.715037 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6355e6-3893-4560-a747-199f23ebe5bf admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.727124 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017023a-3102-4e5c-b44e-8671f143fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.729277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017023a-3102-4e5c-b44e-8671f143fe0f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.729656 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017023a-3102-4e5c-b44e-8671f143fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.730067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017023a-3102-4e5c-b44e-8671f143fe0f admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.736371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-ab05ebb5-236d-40c2-8a58-74b631e39380 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:39.743325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 209/421] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 113 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:39.747177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017023a-3102-4e5c-b44e-8671f143fe0f admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.749195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017023a-3102-4e5c-b44e-8671f143fe0f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.749725 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05ebb5-236d-40c2-8a58-74b631e39380 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.762213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05ebb5-236d-40c2-8a58-74b631e39380 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.764067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-7017023a-3102-4e5c-b44e-8671f143fe0f admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:00:39.765604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 213/422] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/users/neutron => generated 85 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:39.767614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850bda2-9999-49a5-91d9-c779f96c9f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.768294 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850bda2-9999-49a5-91d9-c779f96c9f00 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.768575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850bda2-9999-49a5-91d9-c779f96c9f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.769036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e850bda2-9999-49a5-91d9-c779f96c9f00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.769767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850bda2-9999-49a5-91d9-c779f96c9f00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.770228 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850bda2-9999-49a5-91d9-c779f96c9f00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.771738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017023a-3102-4e5c-b44e-8671f143fe0f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.771971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e850bda2-9999-49a5-91d9-c779f96c9f00 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.784698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017023a-3102-4e5c-b44e-8671f143fe0f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.786583 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 210/423] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.792268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fe018-f358-4ce6-8418-d56855c2caa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.792915 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fe018-f358-4ce6-8418-d56855c2caa6 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.793166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850bda2-9999-49a5-91d9-c779f96c9f00 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.793269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fe018-f358-4ce6-8418-d56855c2caa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.793621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5fe018-f358-4ce6-8418-d56855c2caa6 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.794494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fe018-f358-4ce6-8418-d56855c2caa6 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.794845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fe018-f358-4ce6-8418-d56855c2caa6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.796798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5fe018-f358-4ce6-8418-d56855c2caa6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.804997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e850bda2-9999-49a5-91d9-c779f96c9f00 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.810634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5309f-9488-444b-95b6-c0d290cc8219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.811408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5309f-9488-444b-95b6-c0d290cc8219 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.811685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5309f-9488-444b-95b6-c0d290cc8219 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.811954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c5309f-9488-444b-95b6-c0d290cc8219 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.817746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 214/424] 10.222.0.32 () {56 vars in 1160 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:39.820199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5309f-9488-444b-95b6-c0d290cc8219 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.822158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c5309f-9488-444b-95b6-c0d290cc8219 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.823938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fe018-f358-4ce6-8418-d56855c2caa6 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.833767 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5fe018-f358-4ce6-8418-d56855c2caa6 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.837142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-13c5309f-9488-444b-95b6-c0d290cc8219 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:39.838471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d005204-0faf-4715-9202-a5f14859cea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.840699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d005204-0faf-4715-9202-a5f14859cea6 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.841012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d005204-0faf-4715-9202-a5f14859cea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.841287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d005204-0faf-4715-9202-a5f14859cea6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.842127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 211/425] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:39.844805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5309f-9488-444b-95b6-c0d290cc8219 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.850834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d005204-0faf-4715-9202-a5f14859cea6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.852651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d005204-0faf-4715-9202-a5f14859cea6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.855958 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c5309f-9488-444b-95b6-c0d290cc8219 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.862826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.863557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.863835 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.864105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.864930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.865242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.866263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 215/426] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:00:39.866390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_projects failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:39.866390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:39.866390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:39.867586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.872773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d005204-0faf-4715-9202-a5f14859cea6 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.882624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d005204-0faf-4715-9202-a5f14859cea6 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.887596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6880f-a063-446c-a139-2f5bdd075311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.888501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6880f-a063-446c-a139-2f5bdd075311 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.888775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6880f-a063-446c-a139-2f5bdd075311 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.888944 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 212/427] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:39.889394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6880f-a063-446c-a139-2f5bdd075311 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.896224 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.904190 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6880f-a063-446c-a139-2f5bdd075311 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.906189 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6880f-a063-446c-a139-2f5bdd075311 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.906394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc319394-124f-4d4f-bce0-1129537df103 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.911416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fe6cb-a1fa-4195-a86b-91cc685c512d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.912062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fe6cb-a1fa-4195-a86b-91cc685c512d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.912339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fe6cb-a1fa-4195-a86b-91cc685c512d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.912610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626fe6cb-a1fa-4195-a86b-91cc685c512d admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.913446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fe6cb-a1fa-4195-a86b-91cc685c512d admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=9f402e17093e4e99afda5ea019f335eb) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.913749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fe6cb-a1fa-4195-a86b-91cc685c512d admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.915589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626fe6cb-a1fa-4195-a86b-91cc685c512d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.926219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 213/428] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/role_assignments?user.id=9f402e17093e4e99afda5ea019f335eb&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.926503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-cfd6880f-a063-446c-a139-2f5bdd075311 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:39.927807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 216/429] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:39.934276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fe6cb-a1fa-4195-a86b-91cc685c512d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.947283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626fe6cb-a1fa-4195-a86b-91cc685c512d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:39.952167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7860ffd-1ae6-4ef9-8c0a-66823b59983b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:39.952851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7860ffd-1ae6-4ef9-8c0a-66823b59983b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:39.953183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7860ffd-1ae6-4ef9-8c0a-66823b59983b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:39.953454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7860ffd-1ae6-4ef9-8c0a-66823b59983b admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:39.954266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7860ffd-1ae6-4ef9-8c0a-66823b59983b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:39.954584 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7860ffd-1ae6-4ef9-8c0a-66823b59983b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:39.957496 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7860ffd-1ae6-4ef9-8c0a-66823b59983b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:39.970641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 214/430] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:39.976779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6880f-a063-446c-a139-2f5bdd075311 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:39.993579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6880f-a063-446c-a139-2f5bdd075311 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:40.004123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c085eb6-a128-4242-ba92-3e88487de306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:40.005024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c085eb6-a128-4242-ba92-3e88487de306 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:40.005299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c085eb6-a128-4242-ba92-3e88487de306 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:40.005569 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c085eb6-a128-4242-ba92-3e88487de306 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:40.013729 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c085eb6-a128-4242-ba92-3e88487de306 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:40.015881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c085eb6-a128-4242-ba92-3e88487de306 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:40.031268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-7c085eb6-a128-4242-ba92-3e88487de306 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:40.032797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 217/431] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:39 2021] GET /identity/v3/projects/service => generated 88 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:40.039377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7860ffd-1ae6-4ef9-8c0a-66823b59983b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:40.050001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70defb29-24d0-4953-8d82-657d119f166c None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:40.052719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7860ffd-1ae6-4ef9-8c0a-66823b59983b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:40.055043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70defb29-24d0-4953-8d82-657d119f166c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:40.055505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70defb29-24d0-4953-8d82-657d119f166c None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:40.059889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 218/432] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:40 2021] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:40.060420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843974c8-16c8-460a-a61e-5396c5e7c2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:40.061225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843974c8-16c8-460a-a61e-5396c5e7c2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:40.061507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843974c8-16c8-460a-a61e-5396c5e7c2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:40.061777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843974c8-16c8-460a-a61e-5396c5e7c2d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:40.062695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843974c8-16c8-460a-a61e-5396c5e7c2d1 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:40.062996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843974c8-16c8-460a-a61e-5396c5e7c2d1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:40.066818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaed4e-1d95-40f8-9911-c9b463fbfa8f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:40.067091 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaed4e-1d95-40f8-9911-c9b463fbfa8f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:40.067369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdaed4e-1d95-40f8-9911-c9b463fbfa8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:40.070432 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843974c8-16c8-460a-a61e-5396c5e7c2d1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:40.098898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 215/433] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:40.101150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-bfdaed4e-1d95-40f8-9911-c9b463fbfa8f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:40.106693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bfdaed4e-1d95-40f8-9911-c9b463fbfa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:40.116067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843974c8-16c8-460a-a61e-5396c5e7c2d1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:40.127211 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843974c8-16c8-460a-a61e-5396c5e7c2d1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:40.129627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 219/434] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:40 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:40.134194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e27e7-eabe-4b7b-85c6-716874b37626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:40.134905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e27e7-eabe-4b7b-85c6-716874b37626 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:40.135231 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e27e7-eabe-4b7b-85c6-716874b37626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:40.135504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e27e7-eabe-4b7b-85c6-716874b37626 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:40.136410 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e27e7-eabe-4b7b-85c6-716874b37626 admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=66c74b04afed4aabbdbee054438a4933) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:40.136713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e27e7-eabe-4b7b-85c6-716874b37626 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:40.138733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e27e7-eabe-4b7b-85c6-716874b37626 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:40.145379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 216/435] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:40 2021] GET /identity/v3/role_assignments?user.id=66c74b04afed4aabbdbee054438a4933&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 259 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:40.166808 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaed4e-1d95-40f8-9911-c9b463fbfa8f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:40.178013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdaed4e-1d95-40f8-9911-c9b463fbfa8f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:40.182643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0139e34-4cba-425f-811e-a305d26ea58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:40.183460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0139e34-4cba-425f-811e-a305d26ea58a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:40.183735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0139e34-4cba-425f-811e-a305d26ea58a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:40.184006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0139e34-4cba-425f-811e-a305d26ea58a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:40.197920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0139e34-4cba-425f-811e-a305d26ea58a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:40.199850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0139e34-4cba-425f-811e-a305d26ea58a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:40.226664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-c0139e34-4cba-425f-811e-a305d26ea58a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:40.228108 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 220/436] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:40.234858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e27e7-eabe-4b7b-85c6-716874b37626 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:40.249570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e27e7-eabe-4b7b-85c6-716874b37626 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:40.255105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4603136-8f51-42ad-9a71-ef66e068e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:40.255758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4603136-8f51-42ad-9a71-ef66e068e6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:40.256087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4603136-8f51-42ad-9a71-ef66e068e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:40.256355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4603136-8f51-42ad-9a71-ef66e068e6d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:40.257136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4603136-8f51-42ad-9a71-ef66e068e6d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:40.257434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4603136-8f51-42ad-9a71-ef66e068e6d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:40.263524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4603136-8f51-42ad-9a71-ef66e068e6d2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:40.280173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 217/437] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:40.287133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0139e34-4cba-425f-811e-a305d26ea58a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:40.305972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0139e34-4cba-425f-811e-a305d26ea58a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:40.318870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66bb32c-5614-48d2-8303-2d9790ad296e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:40.319572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bb32c-5614-48d2-8303-2d9790ad296e admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:40.319852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bb32c-5614-48d2-8303-2d9790ad296e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:40.320123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66bb32c-5614-48d2-8303-2d9790ad296e admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:40.320875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bb32c-5614-48d2-8303-2d9790ad296e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:40.322892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66bb32c-5614-48d2-8303-2d9790ad296e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:40.439621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 221/438] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:00:40 2021] POST /identity/v3/users => generated 247 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:00:42.002148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934df68-4f52-4035-b1dd-aa2a766a46e3 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.003387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934df68-4f52-4035-b1dd-aa2a766a46e3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.003387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c934df68-4f52-4035-b1dd-aa2a766a46e3 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.005253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 218/439] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:42.011468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9e51-cf58-44c1-8f6e-08dc71462189 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.012006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9e51-cf58-44c1-8f6e-08dc71462189 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.012006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f9e51-cf58-44c1-8f6e-08dc71462189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.030471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e88f9e51-cf58-44c1-8f6e-08dc71462189 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:42.031661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e88f9e51-cf58-44c1-8f6e-08dc71462189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:42.047396 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 222/440] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:42.095523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934df68-4f52-4035-b1dd-aa2a766a46e3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.111559 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c934df68-4f52-4035-b1dd-aa2a766a46e3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.122146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233b4a5-a8b4-46ee-b8f7-53b96c912a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.122943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233b4a5-a8b4-46ee-b8f7-53b96c912a25 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.123211 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233b4a5-a8b4-46ee-b8f7-53b96c912a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.123471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3233b4a5-a8b4-46ee-b8f7-53b96c912a25 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.139312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3233b4a5-a8b4-46ee-b8f7-53b96c912a25 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:42.146853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-3233b4a5-a8b4-46ee-b8f7-53b96c912a25 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:42.153663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 219/441] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:42.155049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9e51-cf58-44c1-8f6e-08dc71462189 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.164848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f9e51-cf58-44c1-8f6e-08dc71462189 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.169356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c74e-c21a-4fd9-bc12-682d155686fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.170012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c74e-c21a-4fd9-bc12-682d155686fa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.170317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c74e-c21a-4fd9-bc12-682d155686fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.170588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c74e-c21a-4fd9-bc12-682d155686fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.171347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c74e-c21a-4fd9-bc12-682d155686fa admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:42.171647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c74e-c21a-4fd9-bc12-682d155686fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.173239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c74e-c21a-4fd9-bc12-682d155686fa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.187843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 223/442] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:42.189232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233b4a5-a8b4-46ee-b8f7-53b96c912a25 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.199578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3233b4a5-a8b4-46ee-b8f7-53b96c912a25 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.204246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f88362-6d41-41ce-a590-ee0a3c0fec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.205060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f88362-6d41-41ce-a590-ee0a3c0fec87 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.205374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f88362-6d41-41ce-a590-ee0a3c0fec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.205663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f88362-6d41-41ce-a590-ee0a3c0fec87 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.217155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f88362-6d41-41ce-a590-ee0a3c0fec87 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.219027 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f88362-6d41-41ce-a590-ee0a3c0fec87 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.238647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e8f88362-6d41-41ce-a590-ee0a3c0fec87 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:42.245119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 220/443] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:42.246651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c74e-c21a-4fd9-bc12-682d155686fa admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.257334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c74e-c21a-4fd9-bc12-682d155686fa admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.261768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0950c-f90c-4a14-afd5-c8f1eb201110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.262475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0950c-f90c-4a14-afd5-c8f1eb201110 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.262749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0950c-f90c-4a14-afd5-c8f1eb201110 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.263018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0950c-f90c-4a14-afd5-c8f1eb201110 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.263756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0950c-f90c-4a14-afd5-c8f1eb201110 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:42.264057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0950c-f90c-4a14-afd5-c8f1eb201110 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.265681 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0950c-f90c-4a14-afd5-c8f1eb201110 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.285481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 224/444] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:42.291472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f88362-6d41-41ce-a590-ee0a3c0fec87 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.301849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f88362-6d41-41ce-a590-ee0a3c0fec87 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.310182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9fe2c8-2c02-457c-85e7-950469807080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.310975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fe2c8-2c02-457c-85e7-950469807080 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.311254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fe2c8-2c02-457c-85e7-950469807080 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.311526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9fe2c8-2c02-457c-85e7-950469807080 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.325644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fe2c8-2c02-457c-85e7-950469807080 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.328839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9fe2c8-2c02-457c-85e7-950469807080 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.344675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-8b9fe2c8-2c02-457c-85e7-950469807080 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:00:42.345978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 221/445] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/users/nova => generated 82 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:42.352146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0950c-f90c-4a14-afd5-c8f1eb201110 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.371010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0950c-f90c-4a14-afd5-c8f1eb201110 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.378179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b865f1-018a-4879-8b13-827291336158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.378863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b865f1-018a-4879-8b13-827291336158 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.379139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b865f1-018a-4879-8b13-827291336158 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.379406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b865f1-018a-4879-8b13-827291336158 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.380267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b865f1-018a-4879-8b13-827291336158 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:42.380567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b865f1-018a-4879-8b13-827291336158 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.382477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b865f1-018a-4879-8b13-827291336158 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.413977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 225/446] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:42.420150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cd409-34e4-4dbc-8a10-244f284ef577 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.420466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cd409-34e4-4dbc-8a10-244f284ef577 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.420625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b865f1-018a-4879-8b13-827291336158 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.420781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9cd409-34e4-4dbc-8a10-244f284ef577 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.422948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 222/447] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:42.431467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b865f1-018a-4879-8b13-827291336158 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.434153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23d13b-fc03-4c03-b475-0f310b9c42a1 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.434505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23d13b-fc03-4c03-b475-0f310b9c42a1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.434865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23d13b-fc03-4c03-b475-0f310b9c42a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.436411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6feea-2592-45dc-9d5d-ab0e6553632d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.437192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6feea-2592-45dc-9d5d-ab0e6553632d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.437469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6feea-2592-45dc-9d5d-ab0e6553632d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.437740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b6feea-2592-45dc-9d5d-ab0e6553632d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.460591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6feea-2592-45dc-9d5d-ab0e6553632d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.462924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b6feea-2592-45dc-9d5d-ab0e6553632d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.474017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-fd23d13b-fc03-4c03-b475-0f310b9c42a1 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:42.475216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-fd23d13b-fc03-4c03-b475-0f310b9c42a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:42.481611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-33b6feea-2592-45dc-9d5d-ab0e6553632d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:42.489028 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 226/448] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:42.490445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6feea-2592-45dc-9d5d-ab0e6553632d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.499540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 223/449] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:42.500772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b6feea-2592-45dc-9d5d-ab0e6553632d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.506246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42debce-bd56-47c3-a25d-471b2516ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.506997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42debce-bd56-47c3-a25d-471b2516ab2d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.507322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42debce-bd56-47c3-a25d-471b2516ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.507699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42debce-bd56-47c3-a25d-471b2516ab2d admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.508382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42debce-bd56-47c3-a25d-471b2516ab2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:42.508734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42debce-bd56-47c3-a25d-471b2516ab2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.510402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42debce-bd56-47c3-a25d-471b2516ab2d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.528978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 227/450] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:42.530418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23d13b-fc03-4c03-b475-0f310b9c42a1 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.537472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba39250-e648-43f9-942e-bcb9f4142786 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.537755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba39250-e648-43f9-942e-bcb9f4142786 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.538073 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba39250-e648-43f9-942e-bcb9f4142786 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.540093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 228/451] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:42.541265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23d13b-fc03-4c03-b475-0f310b9c42a1 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.543249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba39250-e648-43f9-942e-bcb9f4142786 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.546661 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c26b2d-2831-47d9-a03c-d74633b9612f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.547718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c26b2d-2831-47d9-a03c-d74633b9612f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.548140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c26b2d-2831-47d9-a03c-d74633b9612f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.548414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c26b2d-2831-47d9-a03c-d74633b9612f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.557412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c26b2d-2831-47d9-a03c-d74633b9612f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.557867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba39250-e648-43f9-942e-bcb9f4142786 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.559805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c26b2d-2831-47d9-a03c-d74633b9612f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.562458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea190-a66f-43d8-92b0-b2db8ee85dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.563375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea190-a66f-43d8-92b0-b2db8ee85dde admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.563658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea190-a66f-43d8-92b0-b2db8ee85dde admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.563929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdea190-a66f-43d8-92b0-b2db8ee85dde admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.574861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdea190-a66f-43d8-92b0-b2db8ee85dde admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:42.575122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-73c26b2d-2831-47d9-a03c-d74633b9612f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:42.582905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 224/452] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:42.583123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-0bdea190-a66f-43d8-92b0-b2db8ee85dde admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:42.583515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694be99a-5c7b-4d54-abb2-b3f82bbc7cad None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.583795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694be99a-5c7b-4d54-abb2-b3f82bbc7cad None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.584045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 229/453] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:42.584198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694be99a-5c7b-4d54-abb2-b3f82bbc7cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.586627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea190-a66f-43d8-92b0-b2db8ee85dde admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.598382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdea190-a66f-43d8-92b0-b2db8ee85dde admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.603385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edef96-f8ba-4c21-9e0a-1a304f00fb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.605310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-694be99a-5c7b-4d54-abb2-b3f82bbc7cad None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:42.605546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edef96-f8ba-4c21-9e0a-1a304f00fb1f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.605718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edef96-f8ba-4c21-9e0a-1a304f00fb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.605954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94edef96-f8ba-4c21-9e0a-1a304f00fb1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.606541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-694be99a-5c7b-4d54-abb2-b3f82bbc7cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:42.607369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edef96-f8ba-4c21-9e0a-1a304f00fb1f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:42.607676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edef96-f8ba-4c21-9e0a-1a304f00fb1f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.611552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94edef96-f8ba-4c21-9e0a-1a304f00fb1f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.615647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 225/454] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:42 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:42.616991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694be99a-5c7b-4d54-abb2-b3f82bbc7cad None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.626192 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694be99a-5c7b-4d54-abb2-b3f82bbc7cad None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.632491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0783ff-3955-440a-8834-f612c9c46303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.633199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0783ff-3955-440a-8834-f612c9c46303 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.633572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0783ff-3955-440a-8834-f612c9c46303 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.633889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0783ff-3955-440a-8834-f612c9c46303 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.634826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0783ff-3955-440a-8834-f612c9c46303 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:42.635179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0783ff-3955-440a-8834-f612c9c46303 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.636475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 230/455] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:42.642159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0783ff-3955-440a-8834-f612c9c46303 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.650403 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edef96-f8ba-4c21-9e0a-1a304f00fb1f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.652933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 226/456] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:42.653903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0783ff-3955-440a-8834-f612c9c46303 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.660589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94edef96-f8ba-4c21-9e0a-1a304f00fb1f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.665128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a5bf-3493-4759-9622-ac823d439699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.665342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0783ff-3955-440a-8834-f612c9c46303 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.665912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a5bf-3493-4759-9622-ac823d439699 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.666321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a5bf-3493-4759-9622-ac823d439699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.666594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8066a5bf-3493-4759-9622-ac823d439699 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.670494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725b508-56f2-447c-a8c1-fb671a2bf241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.671440 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725b508-56f2-447c-a8c1-fb671a2bf241 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.671984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725b508-56f2-447c-a8c1-fb671a2bf241 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.672259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c725b508-56f2-447c-a8c1-fb671a2bf241 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/d1596a916d784f6bb6e3b876f4820903/roles/4784162e8bd0416c9bc4ef9e01acb1d9` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.677537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8066a5bf-3493-4759-9622-ac823d439699 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:42.684531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-8066a5bf-3493-4759-9622-ac823d439699 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:42.685769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 231/457] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/roles/service => generated 85 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:42.686630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a5bf-3493-4759-9622-ac823d439699 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.690851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725b508-56f2-447c-a8c1-fb671a2bf241 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=d1596a916d784f6bb6e3b876f4820903, role_id=4784162e8bd0416c9bc4ef9e01acb1d9)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.693668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c725b508-56f2-447c-a8c1-fb671a2bf241 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.702756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8066a5bf-3493-4759-9622-ac823d439699 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.707747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653cee2-7d9f-423d-a59c-09ddc0e664ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.712738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653cee2-7d9f-423d-a59c-09ddc0e664ba admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.712738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653cee2-7d9f-423d-a59c-09ddc0e664ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.712738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9653cee2-7d9f-423d-a59c-09ddc0e664ba admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.719368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653cee2-7d9f-423d-a59c-09ddc0e664ba admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.721818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9653cee2-7d9f-423d-a59c-09ddc0e664ba admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.738536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-9653cee2-7d9f-423d-a59c-09ddc0e664ba admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:42.739678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 232/458] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:42.740437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653cee2-7d9f-423d-a59c-09ddc0e664ba admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.749680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9653cee2-7d9f-423d-a59c-09ddc0e664ba admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.754114 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d50f-e930-4ae8-a019-9b3551d0df26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.754729 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d50f-e930-4ae8-a019-9b3551d0df26 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.755007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d50f-e930-4ae8-a019-9b3551d0df26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.755275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446d50f-e930-4ae8-a019-9b3551d0df26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.756041 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446d50f-e930-4ae8-a019-9b3551d0df26 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:42.756342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446d50f-e930-4ae8-a019-9b3551d0df26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.757935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446d50f-e930-4ae8-a019-9b3551d0df26 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.765893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 233/459] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:42.766705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d50f-e930-4ae8-a019-9b3551d0df26 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.778794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 227/460] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:42 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/d1596a916d784f6bb6e3b876f4820903/roles/4784162e8bd0416c9bc4ef9e01acb1d9 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:42.782097 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725b508-56f2-447c-a8c1-fb671a2bf241 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.784025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446d50f-e930-4ae8-a019-9b3551d0df26 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.908425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219df5d2-78d3-40f1-97b0-2eff89d4c1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.909157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219df5d2-78d3-40f1-97b0-2eff89d4c1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.909475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219df5d2-78d3-40f1-97b0-2eff89d4c1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.909748 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219df5d2-78d3-40f1-97b0-2eff89d4c1d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.910531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219df5d2-78d3-40f1-97b0-2eff89d4c1d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:42.910833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219df5d2-78d3-40f1-97b0-2eff89d4c1d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.912495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219df5d2-78d3-40f1-97b0-2eff89d4c1d0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.919311 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c725b508-56f2-447c-a8c1-fb671a2bf241 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.931109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 234/461] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:42.939157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219df5d2-78d3-40f1-97b0-2eff89d4c1d0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:42.941200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887c8c3-86ea-4167-b089-8df5bf006483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.943507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887c8c3-86ea-4167-b089-8df5bf006483 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.943795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887c8c3-86ea-4167-b089-8df5bf006483 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.944070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b887c8c3-86ea-4167-b089-8df5bf006483 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.958092 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219df5d2-78d3-40f1-97b0-2eff89d4c1d0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:42.964770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887c8c3-86ea-4167-b089-8df5bf006483 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:42.968690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b887c8c3-86ea-4167-b089-8df5bf006483 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:42.969505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da63b5-ce7f-4a0a-bb26-2c20ff18b57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:42.970331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da63b5-ce7f-4a0a-bb26-2c20ff18b57b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:42.971021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da63b5-ce7f-4a0a-bb26-2c20ff18b57b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:42.971299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da63b5-ce7f-4a0a-bb26-2c20ff18b57b admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:42.995313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da63b5-ce7f-4a0a-bb26-2c20ff18b57b admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.004527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da63b5-ce7f-4a0a-bb26-2c20ff18b57b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.014172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-b887c8c3-86ea-4167-b089-8df5bf006483 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:43.021047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 228/462] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.027503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887c8c3-86ea-4167-b089-8df5bf006483 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.036282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-c5da63b5-ce7f-4a0a-bb26-2c20ff18b57b admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:00:43.036835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 235/463] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:42 2021] GET /identity/v3/users/cinder => generated 84 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.043608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da63b5-ce7f-4a0a-bb26-2c20ff18b57b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.046155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b887c8c3-86ea-4167-b089-8df5bf006483 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.051505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4067e5a3-60e0-418f-93fb-b456659b3553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.052165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e5a3-60e0-418f-93fb-b456659b3553 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.052442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e5a3-60e0-418f-93fb-b456659b3553 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.052711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4067e5a3-60e0-418f-93fb-b456659b3553 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.053448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067e5a3-60e0-418f-93fb-b456659b3553 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.053746 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067e5a3-60e0-418f-93fb-b456659b3553 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.055450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4067e5a3-60e0-418f-93fb-b456659b3553 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.056409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da63b5-ce7f-4a0a-bb26-2c20ff18b57b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.061868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94bbaa-1286-4c6e-8349-a5633e590a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.062863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94bbaa-1286-4c6e-8349-a5633e590a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.063345 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94bbaa-1286-4c6e-8349-a5633e590a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.063873 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94bbaa-1286-4c6e-8349-a5633e590a7f admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.065663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94bbaa-1286-4c6e-8349-a5633e590a7f admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.066516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94bbaa-1286-4c6e-8349-a5633e590a7f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.068795 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94bbaa-1286-4c6e-8349-a5633e590a7f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.068910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 229/464] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:43.070233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6ec24-4bbf-4930-8b89-db04a75b13e4 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.070512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6ec24-4bbf-4930-8b89-db04a75b13e4 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.070784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6ec24-4bbf-4930-8b89-db04a75b13e4 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.072675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 230/465] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:43.075125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6ec24-4bbf-4930-8b89-db04a75b13e4 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.088072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6ec24-4bbf-4930-8b89-db04a75b13e4 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.092158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 236/466] 10.222.0.32 () {56 vars in 1158 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:43.092700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a7416-b4c9-424b-b09a-cd46eba19280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.093546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a7416-b4c9-424b-b09a-cd46eba19280 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.093753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff46b-407f-4a2e-8282-de091aca1ff0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.093973 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a7416-b4c9-424b-b09a-cd46eba19280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.094215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff46b-407f-4a2e-8282-de091aca1ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.094421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a7416-b4c9-424b-b09a-cd46eba19280 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.098500 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaff46b-407f-4a2e-8282-de091aca1ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.103308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a7416-b4c9-424b-b09a-cd46eba19280 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.105369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a7416-b4c9-424b-b09a-cd46eba19280 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.119742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-0eaff46b-407f-4a2e-8282-de091aca1ff0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:43.120790 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-226a7416-b4c9-424b-b09a-cd46eba19280 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:00:43.121077 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0eaff46b-407f-4a2e-8282-de091aca1ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:43.122154 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 231/467] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/users/glance => generated 84 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.126812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a7416-b4c9-424b-b09a-cd46eba19280 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.133212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 237/468] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:43.134004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaff46b-407f-4a2e-8282-de091aca1ff0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.139325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a7416-b4c9-424b-b09a-cd46eba19280 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.143999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaff46b-407f-4a2e-8282-de091aca1ff0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.144191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3def7a7-d73f-45ec-a36d-c250351c9a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.144967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3def7a7-d73f-45ec-a36d-c250351c9a60 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.145245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3def7a7-d73f-45ec-a36d-c250351c9a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.145515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3def7a7-d73f-45ec-a36d-c250351c9a60 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.149417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7b7cb-bb17-4256-9f25-5e2d3dabb9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.150243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7b7cb-bb17-4256-9f25-5e2d3dabb9fa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.150614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7b7cb-bb17-4256-9f25-5e2d3dabb9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.151014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d7b7cb-bb17-4256-9f25-5e2d3dabb9fa admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.152046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7b7cb-bb17-4256-9f25-5e2d3dabb9fa admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.152435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7b7cb-bb17-4256-9f25-5e2d3dabb9fa admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.154484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d7b7cb-bb17-4256-9f25-5e2d3dabb9fa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.157036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3def7a7-d73f-45ec-a36d-c250351c9a60 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.160123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3def7a7-d73f-45ec-a36d-c250351c9a60 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.178223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 238/469] 10.222.0.32 () {56 vars in 1158 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:43.178766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e3def7a7-d73f-45ec-a36d-c250351c9a60 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:43.180029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 232/470] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.180711 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7b7cb-bb17-4256-9f25-5e2d3dabb9fa admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.183847 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3def7a7-d73f-45ec-a36d-c250351c9a60 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.192415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d7b7cb-bb17-4256-9f25-5e2d3dabb9fa admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.194754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3def7a7-d73f-45ec-a36d-c250351c9a60 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.197234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb320b-771c-4d70-9e2e-bf4b73ba9a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.198235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb320b-771c-4d70-9e2e-bf4b73ba9a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.198610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb320b-771c-4d70-9e2e-bf4b73ba9a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.198976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb320b-771c-4d70-9e2e-bf4b73ba9a2a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.200495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effb0bf-7757-4f84-9dfa-620bd8b82f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.201427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effb0bf-7757-4f84-9dfa-620bd8b82f99 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.201849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effb0bf-7757-4f84-9dfa-620bd8b82f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.202303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effb0bf-7757-4f84-9dfa-620bd8b82f99 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.210417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb320b-771c-4d70-9e2e-bf4b73ba9a2a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.212556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb320b-771c-4d70-9e2e-bf4b73ba9a2a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.214759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3effb0bf-7757-4f84-9dfa-620bd8b82f99 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:43.221666 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-3effb0bf-7757-4f84-9dfa-620bd8b82f99 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:43.223172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 233/471] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:43.223962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effb0bf-7757-4f84-9dfa-620bd8b82f99 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.231272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-d6bb320b-771c-4d70-9e2e-bf4b73ba9a2a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:43.233053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 239/472] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.234099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb320b-771c-4d70-9e2e-bf4b73ba9a2a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.239752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effb0bf-7757-4f84-9dfa-620bd8b82f99 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.244179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5262c34-a2b5-4797-b086-c2c5e0214b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.244835 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5262c34-a2b5-4797-b086-c2c5e0214b11 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.245096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5262c34-a2b5-4797-b086-c2c5e0214b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.245368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5262c34-a2b5-4797-b086-c2c5e0214b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.245933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb320b-771c-4d70-9e2e-bf4b73ba9a2a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.246149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5262c34-a2b5-4797-b086-c2c5e0214b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.246417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5262c34-a2b5-4797-b086-c2c5e0214b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.248183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5262c34-a2b5-4797-b086-c2c5e0214b11 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.251445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d2ff2-a106-4abf-a713-85ae4f65f21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.253237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d2ff2-a106-4abf-a713-85ae4f65f21d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.253820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d2ff2-a106-4abf-a713-85ae4f65f21d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.254311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6d2ff2-a106-4abf-a713-85ae4f65f21d admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.255360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d2ff2-a106-4abf-a713-85ae4f65f21d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.255853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d2ff2-a106-4abf-a713-85ae4f65f21d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.257766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6d2ff2-a106-4abf-a713-85ae4f65f21d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.261251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 234/473] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:43.262172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5262c34-a2b5-4797-b086-c2c5e0214b11 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.267760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 240/474] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:43.268846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d2ff2-a106-4abf-a713-85ae4f65f21d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.278396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5262c34-a2b5-4797-b086-c2c5e0214b11 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.283473 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95175c90-f111-45bf-a866-1c89ac028cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.284082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6d2ff2-a106-4abf-a713-85ae4f65f21d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.284570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95175c90-f111-45bf-a866-1c89ac028cab admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.285041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95175c90-f111-45bf-a866-1c89ac028cab admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.285636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95175c90-f111-45bf-a866-1c89ac028cab admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.286598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95175c90-f111-45bf-a866-1c89ac028cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.287107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95175c90-f111-45bf-a866-1c89ac028cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.288858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95175c90-f111-45bf-a866-1c89ac028cab admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.289034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc130e27-7f4e-409f-bde8-6e4f5093d53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.289835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc130e27-7f4e-409f-bde8-6e4f5093d53c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.290187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc130e27-7f4e-409f-bde8-6e4f5093d53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.290458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc130e27-7f4e-409f-bde8-6e4f5093d53c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.300222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc130e27-7f4e-409f-bde8-6e4f5093d53c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.302684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc130e27-7f4e-409f-bde8-6e4f5093d53c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.303383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 235/475] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:43.304461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95175c90-f111-45bf-a866-1c89ac028cab admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.314679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95175c90-f111-45bf-a866-1c89ac028cab admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.320260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191a2b3-d960-4091-a821-fc98847bc6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.320386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-dc130e27-7f4e-409f-bde8-6e4f5093d53c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:43.321407 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191a2b3-d960-4091-a821-fc98847bc6ad admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.321513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 241/476] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.321964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191a2b3-d960-4091-a821-fc98847bc6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.322245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc130e27-7f4e-409f-bde8-6e4f5093d53c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.322700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191a2b3-d960-4091-a821-fc98847bc6ad admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.333950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191a2b3-d960-4091-a821-fc98847bc6ad admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.334137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc130e27-7f4e-409f-bde8-6e4f5093d53c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.336380 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e191a2b3-d960-4091-a821-fc98847bc6ad admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.338648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f168-b322-4022-a364-5879bd34a1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.339753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f168-b322-4022-a364-5879bd34a1e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.340039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f168-b322-4022-a364-5879bd34a1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.340314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17f168-b322-4022-a364-5879bd34a1e4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.348362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17f168-b322-4022-a364-5879bd34a1e4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.350363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17f168-b322-4022-a364-5879bd34a1e4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.355525 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e191a2b3-d960-4091-a821-fc98847bc6ad admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:43.356979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 236/477] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.357986 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191a2b3-d960-4091-a821-fc98847bc6ad admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.371408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191a2b3-d960-4091-a821-fc98847bc6ad admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.372372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-6d17f168-b322-4022-a364-5879bd34a1e4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:43.374148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 242/478] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.375122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f168-b322-4022-a364-5879bd34a1e4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.382744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef18b6-588e-4764-a56e-92f0b12593c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.383395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef18b6-588e-4764-a56e-92f0b12593c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.383674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef18b6-588e-4764-a56e-92f0b12593c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.383943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef18b6-588e-4764-a56e-92f0b12593c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.384747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef18b6-588e-4764-a56e-92f0b12593c2 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.385050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef18b6-588e-4764-a56e-92f0b12593c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.386935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef18b6-588e-4764-a56e-92f0b12593c2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.395998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17f168-b322-4022-a364-5879bd34a1e4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.400324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 237/479] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:43.400829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9dd9d-84fc-4f77-aed1-ddc043b1b035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.401614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9dd9d-84fc-4f77-aed1-ddc043b1b035 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.401898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9dd9d-84fc-4f77-aed1-ddc043b1b035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.402124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef18b6-588e-4764-a56e-92f0b12593c2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.402223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b9dd9d-84fc-4f77-aed1-ddc043b1b035 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.402916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9dd9d-84fc-4f77-aed1-ddc043b1b035 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.403222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9dd9d-84fc-4f77-aed1-ddc043b1b035 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.404788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b9dd9d-84fc-4f77-aed1-ddc043b1b035 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.413476 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef18b6-588e-4764-a56e-92f0b12593c2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.417642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 243/480] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:43.418572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a10fd9-27ca-4cf6-80e5-d2332c92b5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.418697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9dd9d-84fc-4f77-aed1-ddc043b1b035 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.419710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a10fd9-27ca-4cf6-80e5-d2332c92b5cc admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.420197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a10fd9-27ca-4cf6-80e5-d2332c92b5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.420657 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a10fd9-27ca-4cf6-80e5-d2332c92b5cc admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.421668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a10fd9-27ca-4cf6-80e5-d2332c92b5cc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.422232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a10fd9-27ca-4cf6-80e5-d2332c92b5cc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.425080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a10fd9-27ca-4cf6-80e5-d2332c92b5cc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.428979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b9dd9d-84fc-4f77-aed1-ddc043b1b035 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.433419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a15696-b851-4451-9280-1d10258bcabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.434307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a15696-b851-4451-9280-1d10258bcabe admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.434590 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a15696-b851-4451-9280-1d10258bcabe admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.434864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a15696-b851-4451-9280-1d10258bcabe admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/6d490db0d91a4426930130a4f83f7bc7/roles/4784162e8bd0416c9bc4ef9e01acb1d9` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.439849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 238/481] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:43.440957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a10fd9-27ca-4cf6-80e5-d2332c92b5cc admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.450858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a10fd9-27ca-4cf6-80e5-d2332c92b5cc admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.455736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a86252-2d20-4775-9daf-7253a2b4f539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.456186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a15696-b851-4451-9280-1d10258bcabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=6d490db0d91a4426930130a4f83f7bc7, role_id=4784162e8bd0416c9bc4ef9e01acb1d9)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.457006 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a86252-2d20-4775-9daf-7253a2b4f539 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.457591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a86252-2d20-4775-9daf-7253a2b4f539 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.458189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a86252-2d20-4775-9daf-7253a2b4f539 admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.459103 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a15696-b851-4451-9280-1d10258bcabe admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.466750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a86252-2d20-4775-9daf-7253a2b4f539 admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.469133 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a86252-2d20-4775-9daf-7253a2b4f539 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.485936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-f9a86252-2d20-4775-9daf-7253a2b4f539 admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:00:43.488267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 239/482] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/users/neutron => generated 85 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.488785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a86252-2d20-4775-9daf-7253a2b4f539 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.499371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a86252-2d20-4775-9daf-7253a2b4f539 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.504075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccc545-0c39-41a7-82f8-71710c6f0472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.504957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccc545-0c39-41a7-82f8-71710c6f0472 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.505229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccc545-0c39-41a7-82f8-71710c6f0472 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.505492 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccc545-0c39-41a7-82f8-71710c6f0472 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/9f402e17093e4e99afda5ea019f335eb/roles/4784162e8bd0416c9bc4ef9e01acb1d9` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.520351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccc545-0c39-41a7-82f8-71710c6f0472 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=9f402e17093e4e99afda5ea019f335eb, role_id=4784162e8bd0416c9bc4ef9e01acb1d9)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.523165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccc545-0c39-41a7-82f8-71710c6f0472 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.645501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 244/483] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:43 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/6d490db0d91a4426930130a4f83f7bc7/roles/4784162e8bd0416c9bc4ef9e01acb1d9 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:43.646393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a15696-b851-4451-9280-1d10258bcabe admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.686013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 240/484] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:43 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/9f402e17093e4e99afda5ea019f335eb/roles/4784162e8bd0416c9bc4ef9e01acb1d9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:43.686013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aa787-c032-46b0-bfe0-e1997e80f4f4 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.686013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aa787-c032-46b0-bfe0-e1997e80f4f4 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.686013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5aa787-c032-46b0-bfe0-e1997e80f4f4 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.686013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 241/485] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:43 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:43.691500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdd569-c221-4eb9-8986-4b2d56ff7b88 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.691791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdd569-c221-4eb9-8986-4b2d56ff7b88 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.692041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafdd569-c221-4eb9-8986-4b2d56ff7b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.731398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-cafdd569-c221-4eb9-8986-4b2d56ff7b88 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:43.732641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-cafdd569-c221-4eb9-8986-4b2d56ff7b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:43.750762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a15696-b851-4451-9280-1d10258bcabe admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.843265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 242/486] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:43 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:43.858933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5810ddc-30aa-4567-8bbe-7ea23d5bc905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.859503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810ddc-30aa-4567-8bbe-7ea23d5bc905 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.859777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810ddc-30aa-4567-8bbe-7ea23d5bc905 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.860043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5810ddc-30aa-4567-8bbe-7ea23d5bc905 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.860912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5810ddc-30aa-4567-8bbe-7ea23d5bc905 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.861243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5810ddc-30aa-4567-8bbe-7ea23d5bc905 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.864097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5810ddc-30aa-4567-8bbe-7ea23d5bc905 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.882395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdd569-c221-4eb9-8986-4b2d56ff7b88 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.892886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafdd569-c221-4eb9-8986-4b2d56ff7b88 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.897277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 245/487] 10.222.0.32 () {56 vars in 1160 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:43.904435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5810ddc-30aa-4567-8bbe-7ea23d5bc905 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.906463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8e902-18d6-4c8f-9ad7-11332824f1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.907548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8e902-18d6-4c8f-9ad7-11332824f1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.908036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8e902-18d6-4c8f-9ad7-11332824f1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.908613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8e902-18d6-4c8f-9ad7-11332824f1c2 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.917684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5810ddc-30aa-4567-8bbe-7ea23d5bc905 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.922959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6894-97de-40f1-8fe8-75ed17379b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.923900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6894-97de-40f1-8fe8-75ed17379b15 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.926682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6894-97de-40f1-8fe8-75ed17379b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.926996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88b6894-97de-40f1-8fe8-75ed17379b15 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.931802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8e902-18d6-4c8f-9ad7-11332824f1c2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:43.942260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-fcb8e902-18d6-4c8f-9ad7-11332824f1c2 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:43.942446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6894-97de-40f1-8fe8-75ed17379b15 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.944202 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88b6894-97de-40f1-8fe8-75ed17379b15 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.944409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 243/488] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/roles/service => generated 85 bytes in 62 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:43.950477 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8e902-18d6-4c8f-9ad7-11332824f1c2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.961737 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8e902-18d6-4c8f-9ad7-11332824f1c2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.963097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-c88b6894-97de-40f1-8fe8-75ed17379b15 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:43.967051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 246/489] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/domains/Default => generated 87 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:43.971508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6894-97de-40f1-8fe8-75ed17379b15 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:43.972533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9ef47-e701-4a95-81a6-81c3eb3e9eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.973319 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9ef47-e701-4a95-81a6-81c3eb3e9eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.973654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9ef47-e701-4a95-81a6-81c3eb3e9eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.974101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9ef47-e701-4a95-81a6-81c3eb3e9eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.974879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9ef47-e701-4a95-81a6-81c3eb3e9eb1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.975289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9ef47-e701-4a95-81a6-81c3eb3e9eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.977030 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff9ef47-e701-4a95-81a6-81c3eb3e9eb1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.983823 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88b6894-97de-40f1-8fe8-75ed17379b15 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:43.989909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c46a0-50d9-4f39-ac8a-67fb8a551884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:43.990797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c46a0-50d9-4f39-ac8a-67fb8a551884 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:43.991834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c46a0-50d9-4f39-ac8a-67fb8a551884 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:43.992257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067c46a0-50d9-4f39-ac8a-67fb8a551884 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:43.993131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c46a0-50d9-4f39-ac8a-67fb8a551884 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:43.993836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c46a0-50d9-4f39-ac8a-67fb8a551884 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:43.995604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067c46a0-50d9-4f39-ac8a-67fb8a551884 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:43.997322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 244/490] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:44.004758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9ef47-e701-4a95-81a6-81c3eb3e9eb1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.008852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 247/491] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:44.015679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9ef47-e701-4a95-81a6-81c3eb3e9eb1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.016122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c46a0-50d9-4f39-ac8a-67fb8a551884 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.021379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54501a5-b564-4f7f-9b72-ca8ea2ab0fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.022419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54501a5-b564-4f7f-9b72-ca8ea2ab0fec admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.022695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54501a5-b564-4f7f-9b72-ca8ea2ab0fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.023216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54501a5-b564-4f7f-9b72-ca8ea2ab0fec admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.028481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067c46a0-50d9-4f39-ac8a-67fb8a551884 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.035431 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655474c6-2891-48b8-9eab-a949a1b3fb36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.035879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54501a5-b564-4f7f-9b72-ca8ea2ab0fec admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.036225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655474c6-2891-48b8-9eab-a949a1b3fb36 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.036502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655474c6-2891-48b8-9eab-a949a1b3fb36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.037029 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655474c6-2891-48b8-9eab-a949a1b3fb36 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.037843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54501a5-b564-4f7f-9b72-ca8ea2ab0fec admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.044963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655474c6-2891-48b8-9eab-a949a1b3fb36 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.047477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655474c6-2891-48b8-9eab-a949a1b3fb36 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.058443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-f54501a5-b564-4f7f-9b72-ca8ea2ab0fec admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:44.059964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 245/492] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:44.062508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-655474c6-2891-48b8-9eab-a949a1b3fb36 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:44.063913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 248/493] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:44.070513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655474c6-2891-48b8-9eab-a949a1b3fb36 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.070730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54501a5-b564-4f7f-9b72-ca8ea2ab0fec admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.087038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655474c6-2891-48b8-9eab-a949a1b3fb36 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.089708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54501a5-b564-4f7f-9b72-ca8ea2ab0fec admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.096391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9a4a-e8cb-4190-a2ee-7d3d5fbcc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.097038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9a4a-e8cb-4190-a2ee-7d3d5fbcc602 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.097313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9a4a-e8cb-4190-a2ee-7d3d5fbcc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.097582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c9a4a-e8cb-4190-a2ee-7d3d5fbcc602 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.099605 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c597c-addf-4eca-bb60-5cd6002a0221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.100955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c9a4a-e8cb-4190-a2ee-7d3d5fbcc602 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:44.101257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c9a4a-e8cb-4190-a2ee-7d3d5fbcc602 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.101880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c597c-addf-4eca-bb60-5cd6002a0221 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.102172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c597c-addf-4eca-bb60-5cd6002a0221 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.102431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c597c-addf-4eca-bb60-5cd6002a0221 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.104425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c9a4a-e8cb-4190-a2ee-7d3d5fbcc602 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.105275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c597c-addf-4eca-bb60-5cd6002a0221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:44.105574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c597c-addf-4eca-bb60-5cd6002a0221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.107198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c597c-addf-4eca-bb60-5cd6002a0221 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.129742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 246/494] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:44.131888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 249/495] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:44.136460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c597c-addf-4eca-bb60-5cd6002a0221 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.146615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c597c-addf-4eca-bb60-5cd6002a0221 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.151623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9a4a-e8cb-4190-a2ee-7d3d5fbcc602 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.153310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4beab-01f4-4a88-b3e7-13aa7eb67216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.154370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4beab-01f4-4a88-b3e7-13aa7eb67216 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.154849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4beab-01f4-4a88-b3e7-13aa7eb67216 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.155315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4beab-01f4-4a88-b3e7-13aa7eb67216 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.163592 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c9a4a-e8cb-4190-a2ee-7d3d5fbcc602 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.174773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727722a-8dda-425f-997e-b23bd8c7c052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.174773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727722a-8dda-425f-997e-b23bd8c7c052 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.174773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727722a-8dda-425f-997e-b23bd8c7c052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.174773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c727722a-8dda-425f-997e-b23bd8c7c052 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/66c74b04afed4aabbdbee054438a4933/roles/4784162e8bd0416c9bc4ef9e01acb1d9` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.176527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4beab-01f4-4a88-b3e7-13aa7eb67216 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.178769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff4beab-01f4-4a88-b3e7-13aa7eb67216 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.186561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727722a-8dda-425f-997e-b23bd8c7c052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=66c74b04afed4aabbdbee054438a4933, role_id=4784162e8bd0416c9bc4ef9e01acb1d9)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.189917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c727722a-8dda-425f-997e-b23bd8c7c052 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.202416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-fff4beab-01f4-4a88-b3e7-13aa7eb67216 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:00:44.204008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 247/496] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/users/swift => generated 83 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:44.210521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4beab-01f4-4a88-b3e7-13aa7eb67216 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.222606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4beab-01f4-4a88-b3e7-13aa7eb67216 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.227450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11d948-7c1b-4218-af98-cbfc980725d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.228183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11d948-7c1b-4218-af98-cbfc980725d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.228456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11d948-7c1b-4218-af98-cbfc980725d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.228779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f11d948-7c1b-4218-af98-cbfc980725d9 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.229644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11d948-7c1b-4218-af98-cbfc980725d9 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:44.230018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11d948-7c1b-4218-af98-cbfc980725d9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.231922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f11d948-7c1b-4218-af98-cbfc980725d9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.252161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 248/497] 10.222.0.32 () {56 vars in 1156 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:44.258448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11d948-7c1b-4218-af98-cbfc980725d9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.268289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f11d948-7c1b-4218-af98-cbfc980725d9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.279423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 250/498] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:44 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/66c74b04afed4aabbdbee054438a4933/roles/4784162e8bd0416c9bc4ef9e01acb1d9 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:00:44.279670 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f163d-94ae-46fc-ac9a-c1c0914c4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.280460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f163d-94ae-46fc-ac9a-c1c0914c4a2d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.280786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f163d-94ae-46fc-ac9a-c1c0914c4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.281064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f163d-94ae-46fc-ac9a-c1c0914c4a2d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.291244 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f163d-94ae-46fc-ac9a-c1c0914c4a2d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.293317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f163d-94ae-46fc-ac9a-c1c0914c4a2d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.304481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 249/499] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:00:44.310830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727722a-8dda-425f-997e-b23bd8c7c052 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.383301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c727722a-8dda-425f-997e-b23bd8c7c052 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.389749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf0065-1153-4216-9ab7-b7fb328b2988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.390584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf0065-1153-4216-9ab7-b7fb328b2988 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.390866 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf0065-1153-4216-9ab7-b7fb328b2988 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.391141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cf0065-1153-4216-9ab7-b7fb328b2988 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.405885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf0065-1153-4216-9ab7-b7fb328b2988 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.407934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cf0065-1153-4216-9ab7-b7fb328b2988 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.430834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-18cf0065-1153-4216-9ab7-b7fb328b2988 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:44.432258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 251/500] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/domains/Default => generated 87 bytes in 122 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:44.438408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f163d-94ae-46fc-ac9a-c1c0914c4a2d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.448400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f163d-94ae-46fc-ac9a-c1c0914c4a2d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.453143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26198a4-8ec6-4d0f-959a-7161b1a7f294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.453828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26198a4-8ec6-4d0f-959a-7161b1a7f294 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.454181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26198a4-8ec6-4d0f-959a-7161b1a7f294 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.454453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26198a4-8ec6-4d0f-959a-7161b1a7f294 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.455286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26198a4-8ec6-4d0f-959a-7161b1a7f294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:44.455591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26198a4-8ec6-4d0f-959a-7161b1a7f294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.457372 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26198a4-8ec6-4d0f-959a-7161b1a7f294 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.471383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 250/501] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:44.477939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf0065-1153-4216-9ab7-b7fb328b2988 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.489048 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cf0065-1153-4216-9ab7-b7fb328b2988 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.493827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a2fdf-51f6-4577-ab88-02c8859c74a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.494717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a2fdf-51f6-4577-ab88-02c8859c74a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.494996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a2fdf-51f6-4577-ab88-02c8859c74a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.495265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a2fdf-51f6-4577-ab88-02c8859c74a7 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.503214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a2fdf-51f6-4577-ab88-02c8859c74a7 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.505348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02a2fdf-51f6-4577-ab88-02c8859c74a7 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.520227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-a02a2fdf-51f6-4577-ab88-02c8859c74a7 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:44.521882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 252/502] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:44.528716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26198a4-8ec6-4d0f-959a-7161b1a7f294 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.539756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26198a4-8ec6-4d0f-959a-7161b1a7f294 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.546153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925dc7f7-e585-4f97-9f03-8cab4fe50730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.546810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dc7f7-e585-4f97-9f03-8cab4fe50730 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.547121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dc7f7-e585-4f97-9f03-8cab4fe50730 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.547353 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dc7f7-e585-4f97-9f03-8cab4fe50730 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.548282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dc7f7-e585-4f97-9f03-8cab4fe50730 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:44.548584 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dc7f7-e585-4f97-9f03-8cab4fe50730 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.550639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925dc7f7-e585-4f97-9f03-8cab4fe50730 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.563275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 251/503] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:44.570440 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a2fdf-51f6-4577-ab88-02c8859c74a7 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:44.584454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a2fdf-51f6-4577-ab88-02c8859c74a7 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:44.589165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179acd6-8cbb-4109-816c-869e82e67fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:44.590051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179acd6-8cbb-4109-816c-869e82e67fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:44.590510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179acd6-8cbb-4109-816c-869e82e67fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:44.590953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179acd6-8cbb-4109-816c-869e82e67fc8 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:44.591968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179acd6-8cbb-4109-816c-869e82e67fc8 admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=3856a21179234c9ebcbd4a9bd7ee3945) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:44.592464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179acd6-8cbb-4109-816c-869e82e67fc8 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:44.594530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179acd6-8cbb-4109-816c-869e82e67fc8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:44.601485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 253/504] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:44 2021] GET /identity/v3/role_assignments?user.id=3856a21179234c9ebcbd4a9bd7ee3945&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 259 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:45.455057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b481a53-3f28-42bb-8624-542a15878e09 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.456302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b481a53-3f28-42bb-8624-542a15878e09 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.456807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b481a53-3f28-42bb-8624-542a15878e09 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:45.458922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 252/505] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:45 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:45.465373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05584-1c3d-4c35-8497-5885d99d41d5 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.466308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05584-1c3d-4c35-8497-5885d99d41d5 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.466785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd05584-1c3d-4c35-8497-5885d99d41d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:45.491462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-edd05584-1c3d-4c35-8497-5885d99d41d5 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:45.493002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-edd05584-1c3d-4c35-8497-5885d99d41d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:45.504020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 254/506] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:45 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:45.530448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b481a53-3f28-42bb-8624-542a15878e09 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:45.543510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b481a53-3f28-42bb-8624-542a15878e09 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:45.552933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f62e0e-8f5c-47c9-afe6-a783d6b4b3d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:45.553988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f62e0e-8f5c-47c9-afe6-a783d6b4b3d9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.554487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f62e0e-8f5c-47c9-afe6-a783d6b4b3d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.554954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f62e0e-8f5c-47c9-afe6-a783d6b4b3d9 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:45.570103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f62e0e-8f5c-47c9-afe6-a783d6b4b3d9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:45.577495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-b2f62e0e-8f5c-47c9-afe6-a783d6b4b3d9 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:45.579335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 253/507] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:45 2021] GET /identity/v3/roles/service => generated 85 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:45.585998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05584-1c3d-4c35-8497-5885d99d41d5 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:45.595371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd05584-1c3d-4c35-8497-5885d99d41d5 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:45.605638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1cc8a-ca05-498b-9459-3a29a844ed9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:45.606640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1cc8a-ca05-498b-9459-3a29a844ed9c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.607116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1cc8a-ca05-498b-9459-3a29a844ed9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.607580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1cc8a-ca05-498b-9459-3a29a844ed9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:45.608536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1cc8a-ca05-498b-9459-3a29a844ed9c admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:45.609045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1cc8a-ca05-498b-9459-3a29a844ed9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:45.610854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1cc8a-ca05-498b-9459-3a29a844ed9c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:45.620168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 255/508] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:45 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:45.626264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f62e0e-8f5c-47c9-afe6-a783d6b4b3d9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:45.637066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f62e0e-8f5c-47c9-afe6-a783d6b4b3d9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:45.646690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac90ae-41fa-49a0-ba39-603b438dbdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:45.647482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac90ae-41fa-49a0-ba39-603b438dbdca admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.647997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac90ae-41fa-49a0-ba39-603b438dbdca admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.648268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ac90ae-41fa-49a0-ba39-603b438dbdca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:45.667514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac90ae-41fa-49a0-ba39-603b438dbdca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:45.669331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ac90ae-41fa-49a0-ba39-603b438dbdca admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:45.691979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e9ac90ae-41fa-49a0-ba39-603b438dbdca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:45.693354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 254/509] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:45.699192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1cc8a-ca05-498b-9459-3a29a844ed9c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:45.714969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1cc8a-ca05-498b-9459-3a29a844ed9c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:45.723521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fad37-24c7-4779-a53b-9072a857ec57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:45.724183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fad37-24c7-4779-a53b-9072a857ec57 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.724463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fad37-24c7-4779-a53b-9072a857ec57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.724732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fad37-24c7-4779-a53b-9072a857ec57 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:45.725472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fad37-24c7-4779-a53b-9072a857ec57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:45.725772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fad37-24c7-4779-a53b-9072a857ec57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:45.731483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0fad37-24c7-4779-a53b-9072a857ec57 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:45.747225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 256/510] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:45.753081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac90ae-41fa-49a0-ba39-603b438dbdca admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:45.766845 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ac90ae-41fa-49a0-ba39-603b438dbdca admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:45.774234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974bd25-7512-4d4b-b794-3593d7a4f87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:45.775008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974bd25-7512-4d4b-b794-3593d7a4f87b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.775284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974bd25-7512-4d4b-b794-3593d7a4f87b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.775580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974bd25-7512-4d4b-b794-3593d7a4f87b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:45.795162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974bd25-7512-4d4b-b794-3593d7a4f87b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:45.797136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e974bd25-7512-4d4b-b794-3593d7a4f87b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:45.822335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e974bd25-7512-4d4b-b794-3593d7a4f87b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:00:45.823812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 255/511] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Oct 27 01:00:45 2021] GET /identity/v3/users/nova => generated 82 bytes in 71 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:45.829622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fad37-24c7-4779-a53b-9072a857ec57 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:45.847317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0fad37-24c7-4779-a53b-9072a857ec57 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:45.861312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e787fb-769d-4e4e-bbae-4188d75fd891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:45.862066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e787fb-769d-4e4e-bbae-4188d75fd891 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.862455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e787fb-769d-4e4e-bbae-4188d75fd891 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.862739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e787fb-769d-4e4e-bbae-4188d75fd891 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:45.863596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e787fb-769d-4e4e-bbae-4188d75fd891 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:45.863904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e787fb-769d-4e4e-bbae-4188d75fd891 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:45.865725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e787fb-769d-4e4e-bbae-4188d75fd891 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:45.893972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 257/512] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Oct 27 01:00:45 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:45.899965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974bd25-7512-4d4b-b794-3593d7a4f87b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:45.914957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e974bd25-7512-4d4b-b794-3593d7a4f87b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:45.922278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625521b-89c5-4d09-8c2b-6acd86d04475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:45.922921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625521b-89c5-4d09-8c2b-6acd86d04475 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.923194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625521b-89c5-4d09-8c2b-6acd86d04475 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.923464 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7625521b-89c5-4d09-8c2b-6acd86d04475 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:45.937674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625521b-89c5-4d09-8c2b-6acd86d04475 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:45.939410 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7625521b-89c5-4d09-8c2b-6acd86d04475 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:45.951655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 256/513] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:45 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:45.957542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e787fb-769d-4e4e-bbae-4188d75fd891 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:45.975689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e787fb-769d-4e4e-bbae-4188d75fd891 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:45.982205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f0a53-6721-42b0-9327-7665c01fdd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:45.983348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f0a53-6721-42b0-9327-7665c01fdd8b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:45.983837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f0a53-6721-42b0-9327-7665c01fdd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:45.984305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f0a53-6721-42b0-9327-7665c01fdd8b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.000761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f0a53-6721-42b0-9327-7665c01fdd8b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.002742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f0a53-6721-42b0-9327-7665c01fdd8b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.027312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-4e2f0a53-6721-42b0-9327-7665c01fdd8b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:46.028857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 258/514] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:45 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:46.035450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625521b-89c5-4d09-8c2b-6acd86d04475 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.046907 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7625521b-89c5-4d09-8c2b-6acd86d04475 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.057765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323058b-9a51-48a9-acce-93f237040c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.058447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323058b-9a51-48a9-acce-93f237040c0e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.058719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323058b-9a51-48a9-acce-93f237040c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.058988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323058b-9a51-48a9-acce-93f237040c0e admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.059727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323058b-9a51-48a9-acce-93f237040c0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:46.060020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323058b-9a51-48a9-acce-93f237040c0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.061590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323058b-9a51-48a9-acce-93f237040c0e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.078891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 257/515] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:46.085665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f0a53-6721-42b0-9327-7665c01fdd8b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.100019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f0a53-6721-42b0-9327-7665c01fdd8b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.107476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532e86c-8537-43f9-b7d1-5ddcbe03470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.108364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532e86c-8537-43f9-b7d1-5ddcbe03470d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.108639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532e86c-8537-43f9-b7d1-5ddcbe03470d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.108906 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532e86c-8537-43f9-b7d1-5ddcbe03470d admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.121410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532e86c-8537-43f9-b7d1-5ddcbe03470d admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.123465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3532e86c-8537-43f9-b7d1-5ddcbe03470d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.139305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-3532e86c-8537-43f9-b7d1-5ddcbe03470d admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:46.140542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 259/516] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/projects/service => generated 88 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:46.147433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323058b-9a51-48a9-acce-93f237040c0e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.167395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323058b-9a51-48a9-acce-93f237040c0e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.178631 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be072083-6831-47ad-ad11-3d30b4418ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.179301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be072083-6831-47ad-ad11-3d30b4418ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.179573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be072083-6831-47ad-ad11-3d30b4418ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.179838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be072083-6831-47ad-ad11-3d30b4418ac7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.180642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be072083-6831-47ad-ad11-3d30b4418ac7 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:46.180940 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be072083-6831-47ad-ad11-3d30b4418ac7 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.182786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be072083-6831-47ad-ad11-3d30b4418ac7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.204681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 258/517] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:46.211460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532e86c-8537-43f9-b7d1-5ddcbe03470d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.225787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532e86c-8537-43f9-b7d1-5ddcbe03470d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.232716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c36cfd9-b419-4675-b811-64110c9e49bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.233344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36cfd9-b419-4675-b811-64110c9e49bf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.233664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36cfd9-b419-4675-b811-64110c9e49bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.233936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c36cfd9-b419-4675-b811-64110c9e49bf admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.234828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36cfd9-b419-4675-b811-64110c9e49bf admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=d1596a916d784f6bb6e3b876f4820903) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:46.235130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36cfd9-b419-4675-b811-64110c9e49bf admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.237522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c36cfd9-b419-4675-b811-64110c9e49bf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.250553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 260/518] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/role_assignments?user.id=d1596a916d784f6bb6e3b876f4820903&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 608 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:46.466538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e529-6257-4c60-bbfe-2b2746b05fa7 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.467239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e529-6257-4c60-bbfe-2b2746b05fa7 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.467239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6e529-6257-4c60-bbfe-2b2746b05fa7 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.469110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 259/519] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:46.481500 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b1357-bcae-4b1c-bf84-2758c768a17e None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.482160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b1357-bcae-4b1c-bf84-2758c768a17e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.482160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2b1357-bcae-4b1c-bf84-2758c768a17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.507151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ef2b1357-bcae-4b1c-bf84-2758c768a17e None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:46.508380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ef2b1357-bcae-4b1c-bf84-2758c768a17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:46.516418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 261/520] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:46.545602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6e529-6257-4c60-bbfe-2b2746b05fa7 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.561843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6e529-6257-4c60-bbfe-2b2746b05fa7 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.569532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a3464-960e-448d-95c3-531db4e5a74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.570351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a3464-960e-448d-95c3-531db4e5a74f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.570632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a3464-960e-448d-95c3-531db4e5a74f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.570904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a3464-960e-448d-95c3-531db4e5a74f admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.586683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a3464-960e-448d-95c3-531db4e5a74f admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:46.593615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-710a3464-960e-448d-95c3-531db4e5a74f admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:46.600421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 260/521] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:46.601782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b1357-bcae-4b1c-bf84-2758c768a17e None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.613219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2b1357-bcae-4b1c-bf84-2758c768a17e None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.619929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957e3ad-aacc-49dd-8c6b-be9e0defa315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.620596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957e3ad-aacc-49dd-8c6b-be9e0defa315 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.620871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957e3ad-aacc-49dd-8c6b-be9e0defa315 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.621138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b957e3ad-aacc-49dd-8c6b-be9e0defa315 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.621894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957e3ad-aacc-49dd-8c6b-be9e0defa315 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:46.622221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957e3ad-aacc-49dd-8c6b-be9e0defa315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.624040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b957e3ad-aacc-49dd-8c6b-be9e0defa315 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.635582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 262/522] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:46.641708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a3464-960e-448d-95c3-531db4e5a74f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.655928 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a3464-960e-448d-95c3-531db4e5a74f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.661531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed87d06-9ac3-4aee-9aa6-a754122c5318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.662723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed87d06-9ac3-4aee-9aa6-a754122c5318 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.663122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed87d06-9ac3-4aee-9aa6-a754122c5318 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.663548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed87d06-9ac3-4aee-9aa6-a754122c5318 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.677405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed87d06-9ac3-4aee-9aa6-a754122c5318 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.679284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed87d06-9ac3-4aee-9aa6-a754122c5318 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.698626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-6ed87d06-9ac3-4aee-9aa6-a754122c5318 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:46.700117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 261/523] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:46.706868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957e3ad-aacc-49dd-8c6b-be9e0defa315 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.716584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b957e3ad-aacc-49dd-8c6b-be9e0defa315 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.721779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8e8e7-0f8a-412a-b0ea-6b22e719c420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.722459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8e8e7-0f8a-412a-b0ea-6b22e719c420 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.722732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8e8e7-0f8a-412a-b0ea-6b22e719c420 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.722999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab8e8e7-0f8a-412a-b0ea-6b22e719c420 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.723728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8e8e7-0f8a-412a-b0ea-6b22e719c420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:46.724026 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8e8e7-0f8a-412a-b0ea-6b22e719c420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.725592 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab8e8e7-0f8a-412a-b0ea-6b22e719c420 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.738372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 263/524] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:46.744511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed87d06-9ac3-4aee-9aa6-a754122c5318 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.758358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed87d06-9ac3-4aee-9aa6-a754122c5318 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.764665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae6d01-1527-4008-9589-7c9df94ff348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.765449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae6d01-1527-4008-9589-7c9df94ff348 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.765724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae6d01-1527-4008-9589-7c9df94ff348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.765989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae6d01-1527-4008-9589-7c9df94ff348 admin admin] PATH_INFO: `/v3/users/glance` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.774764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae6d01-1527-4008-9589-7c9df94ff348 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.776750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae6d01-1527-4008-9589-7c9df94ff348 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.791169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-8aae6d01-1527-4008-9589-7c9df94ff348 admin admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 27 01:00:46.792642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 262/525] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/users/glance => generated 84 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:46.798597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8e8e7-0f8a-412a-b0ea-6b22e719c420 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.804494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aaade-89e2-4b41-8b03-2fa6a4070c65 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.804769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aaade-89e2-4b41-8b03-2fa6a4070c65 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.805090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40aaade-89e2-4b41-8b03-2fa6a4070c65 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.807178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 263/526] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:46 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:46.811738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab8e8e7-0f8a-412a-b0ea-6b22e719c420 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.813266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883b036-3f71-42e5-b51d-34bb209671e1 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.813543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883b036-3f71-42e5-b51d-34bb209671e1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.813812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883b036-3f71-42e5-b51d-34bb209671e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.824110 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968890c-9a8d-404b-b7b8-d7d2bab578fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.824776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968890c-9a8d-404b-b7b8-d7d2bab578fb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.825053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968890c-9a8d-404b-b7b8-d7d2bab578fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.825319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a968890c-9a8d-404b-b7b8-d7d2bab578fb admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.826195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968890c-9a8d-404b-b7b8-d7d2bab578fb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:46.826496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968890c-9a8d-404b-b7b8-d7d2bab578fb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.828622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a968890c-9a8d-404b-b7b8-d7d2bab578fb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.839103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d883b036-3f71-42e5-b51d-34bb209671e1 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:46.840628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d883b036-3f71-42e5-b51d-34bb209671e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:46.846897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 264/527] 10.222.0.32 () {56 vars in 1158 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:46.852060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 264/528] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:46 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:46.854683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968890c-9a8d-404b-b7b8-d7d2bab578fb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.867128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a968890c-9a8d-404b-b7b8-d7d2bab578fb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.873787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90a38-8934-48fc-9f8f-477b80915b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.874580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90a38-8934-48fc-9f8f-477b80915b3b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.875240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90a38-8934-48fc-9f8f-477b80915b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.875240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd90a38-8934-48fc-9f8f-477b80915b3b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.876443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883b036-3f71-42e5-b51d-34bb209671e1 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.885445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd90a38-8934-48fc-9f8f-477b80915b3b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.887234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883b036-3f71-42e5-b51d-34bb209671e1 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.887354 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd90a38-8934-48fc-9f8f-477b80915b3b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.891925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4c8c-70b4-45a1-b155-3b4da4df7e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.892915 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4c8c-70b4-45a1-b155-3b4da4df7e31 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.893208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4c8c-70b4-45a1-b155-3b4da4df7e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.893569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88d4c8c-70b4-45a1-b155-3b4da4df7e31 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.898321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 265/529] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:46.906686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88d4c8c-70b4-45a1-b155-3b4da4df7e31 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:46.906832 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90a38-8934-48fc-9f8f-477b80915b3b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.914054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e88d4c8c-70b4-45a1-b155-3b4da4df7e31 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:46.915658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 265/530] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/roles/service => generated 85 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:46.917930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd90a38-8934-48fc-9f8f-477b80915b3b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.921981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4c8c-70b4-45a1-b155-3b4da4df7e31 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.922754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a26bb-5139-4855-be97-379f018f6820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.923718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a26bb-5139-4855-be97-379f018f6820 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.924601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a26bb-5139-4855-be97-379f018f6820 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.925003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26a26bb-5139-4855-be97-379f018f6820 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.933326 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88d4c8c-70b4-45a1-b155-3b4da4df7e31 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.936983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a26bb-5139-4855-be97-379f018f6820 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.937815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43965-3fe9-40e9-9b0e-c735fedf3762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.938561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43965-3fe9-40e9-9b0e-c735fedf3762 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.939004 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43965-3fe9-40e9-9b0e-c735fedf3762 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.939368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a43965-3fe9-40e9-9b0e-c735fedf3762 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:46.940176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26a26bb-5139-4855-be97-379f018f6820 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.940812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a43965-3fe9-40e9-9b0e-c735fedf3762 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:46.941175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a43965-3fe9-40e9-9b0e-c735fedf3762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:46.942843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a43965-3fe9-40e9-9b0e-c735fedf3762 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:46.956565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 266/531] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:46.967947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-d26a26bb-5139-4855-be97-379f018f6820 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:46.969619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 266/532] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:46.974807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43965-3fe9-40e9-9b0e-c735fedf3762 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.983147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a26bb-5139-4855-be97-379f018f6820 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:46.986859 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a43965-3fe9-40e9-9b0e-c735fedf3762 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:46.996687 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa189a8-afa8-459a-a38a-5dabc90b6b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:46.999912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa189a8-afa8-459a-a38a-5dabc90b6b82 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:46.999912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa189a8-afa8-459a-a38a-5dabc90b6b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:46.999912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa189a8-afa8-459a-a38a-5dabc90b6b82 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.010080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26a26bb-5139-4855-be97-379f018f6820 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.015412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa189a8-afa8-459a-a38a-5dabc90b6b82 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.017398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa189a8-afa8-459a-a38a-5dabc90b6b82 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.021542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072477df-c6dc-4efd-9b9c-8d73f9d09e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.025198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072477df-c6dc-4efd-9b9c-8d73f9d09e16 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.025482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072477df-c6dc-4efd-9b9c-8d73f9d09e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.025752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072477df-c6dc-4efd-9b9c-8d73f9d09e16 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.028527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072477df-c6dc-4efd-9b9c-8d73f9d09e16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.028842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072477df-c6dc-4efd-9b9c-8d73f9d09e16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.031736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072477df-c6dc-4efd-9b9c-8d73f9d09e16 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.052265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-5fa189a8-afa8-459a-a38a-5dabc90b6b82 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:47.053795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 267/533] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/domains/Default => generated 87 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:47.056522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 267/534] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:46 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:47.062453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa189a8-afa8-459a-a38a-5dabc90b6b82 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.063506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072477df-c6dc-4efd-9b9c-8d73f9d09e16 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.079996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa189a8-afa8-459a-a38a-5dabc90b6b82 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.082366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072477df-c6dc-4efd-9b9c-8d73f9d09e16 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.090419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5fa52-b509-4ef8-aed7-ce337654188b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.091109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e07bf-dccb-49b0-ae79-2a3e1c2700e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.091860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5fa52-b509-4ef8-aed7-ce337654188b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.092745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e07bf-dccb-49b0-ae79-2a3e1c2700e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.093123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5fa52-b509-4ef8-aed7-ce337654188b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.093491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f5fa52-b509-4ef8-aed7-ce337654188b admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.093861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e07bf-dccb-49b0-ae79-2a3e1c2700e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.094720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5fa52-b509-4ef8-aed7-ce337654188b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.095097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15e07bf-dccb-49b0-ae79-2a3e1c2700e3 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.096194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5fa52-b509-4ef8-aed7-ce337654188b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.098119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f5fa52-b509-4ef8-aed7-ce337654188b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.112599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e07bf-dccb-49b0-ae79-2a3e1c2700e3 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.114797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15e07bf-dccb-49b0-ae79-2a3e1c2700e3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.119938 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 268/535] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:47.126519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5fa52-b509-4ef8-aed7-ce337654188b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.139889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-e15e07bf-dccb-49b0-ae79-2a3e1c2700e3 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:47.141456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 268/536] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:47.148313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e07bf-dccb-49b0-ae79-2a3e1c2700e3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.150105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f5fa52-b509-4ef8-aed7-ce337654188b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.159434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15e07bf-dccb-49b0-ae79-2a3e1c2700e3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.164463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2abf9-923d-4673-8aff-52b980448d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.165235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2abf9-923d-4673-8aff-52b980448d7b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.165637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2abf9-923d-4673-8aff-52b980448d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.166082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c2abf9-923d-4673-8aff-52b980448d7b admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.167183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2abf9-923d-4673-8aff-52b980448d7b admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.167610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b669bb-da5b-461c-9dc2-5b478d7142b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.167738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2abf9-923d-4673-8aff-52b980448d7b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.168402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b669bb-da5b-461c-9dc2-5b478d7142b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.168673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b669bb-da5b-461c-9dc2-5b478d7142b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.168937 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b669bb-da5b-461c-9dc2-5b478d7142b8 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.170140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c2abf9-923d-4673-8aff-52b980448d7b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.186797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 269/537] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:47.194359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2abf9-923d-4673-8aff-52b980448d7b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.195333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b669bb-da5b-461c-9dc2-5b478d7142b8 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.201916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b669bb-da5b-461c-9dc2-5b478d7142b8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.212933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c2abf9-923d-4673-8aff-52b980448d7b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.223277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad857021-43e9-45f9-9bcb-c95d60404bf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.226011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857021-43e9-45f9-9bcb-c95d60404bf0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.226413 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857021-43e9-45f9-9bcb-c95d60404bf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.226806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad857021-43e9-45f9-9bcb-c95d60404bf0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.228614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-c2b669bb-da5b-461c-9dc2-5b478d7142b8 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:00:47.229136 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad857021-43e9-45f9-9bcb-c95d60404bf0 admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=9f402e17093e4e99afda5ea019f335eb) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.229594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad857021-43e9-45f9-9bcb-c95d60404bf0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.232615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 269/538] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/users/cinder => generated 84 bytes in 107 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:47.232947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad857021-43e9-45f9-9bcb-c95d60404bf0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.239585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b669bb-da5b-461c-9dc2-5b478d7142b8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.248852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 270/539] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/role_assignments?user.id=9f402e17093e4e99afda5ea019f335eb&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 608 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:47.259607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b669bb-da5b-461c-9dc2-5b478d7142b8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.270637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd19d24-4f01-400c-91dc-505cbc970bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.271331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd19d24-4f01-400c-91dc-505cbc970bd6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.271607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd19d24-4f01-400c-91dc-505cbc970bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.271878 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd19d24-4f01-400c-91dc-505cbc970bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.272993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd19d24-4f01-400c-91dc-505cbc970bd6 admin admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.273295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd19d24-4f01-400c-91dc-505cbc970bd6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.275396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd19d24-4f01-400c-91dc-505cbc970bd6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.312909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 270/540] 10.222.0.32 () {56 vars in 1158 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:47.319806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad857021-43e9-45f9-9bcb-c95d60404bf0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.332131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad857021-43e9-45f9-9bcb-c95d60404bf0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.342757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2acdb8-dd1a-4540-8e8b-8d64ee7d6b19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.343426 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2acdb8-dd1a-4540-8e8b-8d64ee7d6b19 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.343701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2acdb8-dd1a-4540-8e8b-8d64ee7d6b19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.343970 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2acdb8-dd1a-4540-8e8b-8d64ee7d6b19 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.346889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1b95b-647c-4340-8def-ac3fa68c7664 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.347169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1b95b-647c-4340-8def-ac3fa68c7664 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.347435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b1b95b-647c-4340-8def-ac3fa68c7664 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.349301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 271/541] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:47.361932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b811-8890-49aa-98e5-c30e292315a5 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.362238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b811-8890-49aa-98e5-c30e292315a5 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.362509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b811-8890-49aa-98e5-c30e292315a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.371111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2acdb8-dd1a-4540-8e8b-8d64ee7d6b19 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.372896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2acdb8-dd1a-4540-8e8b-8d64ee7d6b19 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.391286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 271/542] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:47.393250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2063b811-8890-49aa-98e5-c30e292315a5 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:47.394737 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2063b811-8890-49aa-98e5-c30e292315a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:47.399429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2acdb8-dd1a-4540-8e8b-8d64ee7d6b19 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.412050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2acdb8-dd1a-4540-8e8b-8d64ee7d6b19 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.416387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 272/543] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:47.420565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c96aee-124a-4500-bb92-4c3d1bd6fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.421360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c96aee-124a-4500-bb92-4c3d1bd6fecc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.421723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c96aee-124a-4500-bb92-4c3d1bd6fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.421998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c96aee-124a-4500-bb92-4c3d1bd6fecc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.434896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c96aee-124a-4500-bb92-4c3d1bd6fecc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.436834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c96aee-124a-4500-bb92-4c3d1bd6fecc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.455866 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-88c96aee-124a-4500-bb92-4c3d1bd6fecc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:47.457157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 272/544] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:47.463372 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063b811-8890-49aa-98e5-c30e292315a5 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.471193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c96aee-124a-4500-bb92-4c3d1bd6fecc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.474037 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063b811-8890-49aa-98e5-c30e292315a5 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.484576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7068e0c-e7aa-476c-84fe-d71db141e2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.485375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068e0c-e7aa-476c-84fe-d71db141e2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.485703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068e0c-e7aa-476c-84fe-d71db141e2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.485970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7068e0c-e7aa-476c-84fe-d71db141e2a3 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.493257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c96aee-124a-4500-bb92-4c3d1bd6fecc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.505280 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a81a8-e426-441e-b28b-7dfde7c2dcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.505869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a81a8-e426-441e-b28b-7dfde7c2dcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.506168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a81a8-e426-441e-b28b-7dfde7c2dcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.506434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648a81a8-e426-441e-b28b-7dfde7c2dcd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.507158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a81a8-e426-441e-b28b-7dfde7c2dcd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.507454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a81a8-e426-441e-b28b-7dfde7c2dcd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.509013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648a81a8-e426-441e-b28b-7dfde7c2dcd7 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.510906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7068e0c-e7aa-476c-84fe-d71db141e2a3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:47.520462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-d7068e0c-e7aa-476c-84fe-d71db141e2a3 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:47.521192 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 273/545] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:47.524577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a517c-8169-42ff-8c19-43081df69c0c None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.524865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a517c-8169-42ff-8c19-43081df69c0c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.525135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a517c-8169-42ff-8c19-43081df69c0c None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.527429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 273/547] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:47.527658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 274/547] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:47.528265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a81a8-e426-441e-b28b-7dfde7c2dcd7 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.534080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a517c-8169-42ff-8c19-43081df69c0c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.541732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648a81a8-e426-441e-b28b-7dfde7c2dcd7 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.547112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a517c-8169-42ff-8c19-43081df69c0c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.549543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e78228b-3a71-4a7f-9bb3-27df9daecac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.550530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78228b-3a71-4a7f-9bb3-27df9daecac1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.551570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78228b-3a71-4a7f-9bb3-27df9daecac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.551570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78228b-3a71-4a7f-9bb3-27df9daecac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.551976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78228b-3a71-4a7f-9bb3-27df9daecac1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.552345 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78228b-3a71-4a7f-9bb3-27df9daecac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.554014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e78228b-3a71-4a7f-9bb3-27df9daecac1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.555441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6be859-4951-4410-8ee3-8349ce22ab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.556419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be859-4951-4410-8ee3-8349ce22ab7c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.556695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be859-4951-4410-8ee3-8349ce22ab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.556963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6be859-4951-4410-8ee3-8349ce22ab7c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.564818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 274/548] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:47.567596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545c287-a544-4c32-869a-e30ac8a62b75 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.567713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6be859-4951-4410-8ee3-8349ce22ab7c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.567804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545c287-a544-4c32-869a-e30ac8a62b75 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.567804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e545c287-a544-4c32-869a-e30ac8a62b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.568480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6be859-4951-4410-8ee3-8349ce22ab7c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.583021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-4d6be859-4951-4410-8ee3-8349ce22ab7c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:47.584212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 275/549] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/projects/service => generated 88 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:47.584968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6be859-4951-4410-8ee3-8349ce22ab7c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.586116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e545c287-a544-4c32-869a-e30ac8a62b75 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:47.587653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e545c287-a544-4c32-869a-e30ac8a62b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:47.595812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 275/550] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:47 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:47.596933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6be859-4951-4410-8ee3-8349ce22ab7c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.597606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545c287-a544-4c32-869a-e30ac8a62b75 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.601949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087424c-4931-42f9-a5c1-b41f4b7dc6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.602747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087424c-4931-42f9-a5c1-b41f4b7dc6aa admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.603017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087424c-4931-42f9-a5c1-b41f4b7dc6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.603282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087424c-4931-42f9-a5c1-b41f4b7dc6aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.608008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e545c287-a544-4c32-869a-e30ac8a62b75 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.616636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d13440-f07b-4852-a7f7-23f199eee52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.617100 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087424c-4931-42f9-a5c1-b41f4b7dc6aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.617293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d13440-f07b-4852-a7f7-23f199eee52c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.617543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d13440-f07b-4852-a7f7-23f199eee52c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.617809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d13440-f07b-4852-a7f7-23f199eee52c admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.618665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d13440-f07b-4852-a7f7-23f199eee52c admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.618965 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d13440-f07b-4852-a7f7-23f199eee52c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.620234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087424c-4931-42f9-a5c1-b41f4b7dc6aa admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.620778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d13440-f07b-4852-a7f7-23f199eee52c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.634841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 276/551] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:47.635321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d13440-f07b-4852-a7f7-23f199eee52c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.641066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-8087424c-4931-42f9-a5c1-b41f4b7dc6aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:47.643184 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 276/552] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:47.643978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087424c-4931-42f9-a5c1-b41f4b7dc6aa admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.645757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d13440-f07b-4852-a7f7-23f199eee52c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.650485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd87a3-8736-42dd-93b7-4088d6b20603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.651272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd87a3-8736-42dd-93b7-4088d6b20603 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.651553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd87a3-8736-42dd-93b7-4088d6b20603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.651827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd87a3-8736-42dd-93b7-4088d6b20603 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.660444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087424c-4931-42f9-a5c1-b41f4b7dc6aa admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.665848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143256a3-f4fc-483d-8322-49e5b7e0af70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.666807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143256a3-f4fc-483d-8322-49e5b7e0af70 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.667238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143256a3-f4fc-483d-8322-49e5b7e0af70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.667662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143256a3-f4fc-483d-8322-49e5b7e0af70 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.667773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd87a3-8736-42dd-93b7-4088d6b20603 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:47.668837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143256a3-f4fc-483d-8322-49e5b7e0af70 admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=6d490db0d91a4426930130a4f83f7bc7) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.669431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143256a3-f4fc-483d-8322-49e5b7e0af70 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.671523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143256a3-f4fc-483d-8322-49e5b7e0af70 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.674697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-74dd87a3-8736-42dd-93b7-4088d6b20603 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:47.676186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 277/553] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/roles/service => generated 85 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:47.676968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd87a3-8736-42dd-93b7-4088d6b20603 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.683061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 277/554] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/role_assignments?user.id=6d490db0d91a4426930130a4f83f7bc7&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 608 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:47.685507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143256a3-f4fc-483d-8322-49e5b7e0af70 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.687109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd87a3-8736-42dd-93b7-4088d6b20603 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.692800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be70a0-7774-4b3b-8808-a8e613d9fc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.693479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be70a0-7774-4b3b-8808-a8e613d9fc40 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.693752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be70a0-7774-4b3b-8808-a8e613d9fc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.694074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be70a0-7774-4b3b-8808-a8e613d9fc40 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.695111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be70a0-7774-4b3b-8808-a8e613d9fc40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.695415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be70a0-7774-4b3b-8808-a8e613d9fc40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.696988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143256a3-f4fc-483d-8322-49e5b7e0af70 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.697150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37be70a0-7774-4b3b-8808-a8e613d9fc40 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.702093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c374faf-7439-439a-9abe-e67bf366a61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.703075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c374faf-7439-439a-9abe-e67bf366a61a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.703490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c374faf-7439-439a-9abe-e67bf366a61a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.703943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c374faf-7439-439a-9abe-e67bf366a61a admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.704875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c374faf-7439-439a-9abe-e67bf366a61a admin admin] RBAC: Adding query filter params (name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.706216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c374faf-7439-439a-9abe-e67bf366a61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.707996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c374faf-7439-439a-9abe-e67bf366a61a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.710963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 278/555] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:47.722332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be70a0-7774-4b3b-8808-a8e613d9fc40 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.723397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 278/556] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:47.734165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c374faf-7439-439a-9abe-e67bf366a61a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.745358 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37be70a0-7774-4b3b-8808-a8e613d9fc40 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.750017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c374faf-7439-439a-9abe-e67bf366a61a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.755879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ef366-0a92-499c-9155-621c7ea3292a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.756611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ef366-0a92-499c-9155-621c7ea3292a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.756889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ef366-0a92-499c-9155-621c7ea3292a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.757155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ef366-0a92-499c-9155-621c7ea3292a admin admin] PATH_INFO: `/v3/users/neutron` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.761849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75610a-c315-4062-9bd9-26a7eadbcd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.762679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75610a-c315-4062-9bd9-26a7eadbcd0c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.762951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75610a-c315-4062-9bd9-26a7eadbcd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.763213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d75610a-c315-4062-9bd9-26a7eadbcd0c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.771323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ef366-0a92-499c-9155-621c7ea3292a admin admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.773596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ef366-0a92-499c-9155-621c7ea3292a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.789067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75610a-c315-4062-9bd9-26a7eadbcd0c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.790941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d75610a-c315-4062-9bd9-26a7eadbcd0c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.806537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-398ef366-0a92-499c-9155-621c7ea3292a admin admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 27 01:00:47.807836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 279/557] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/users/neutron => generated 85 bytes in 87 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:47.817336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ef366-0a92-499c-9155-621c7ea3292a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.824988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-7d75610a-c315-4062-9bd9-26a7eadbcd0c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:47.831057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 279/558] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 102 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:47.838985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75610a-c315-4062-9bd9-26a7eadbcd0c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.844468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ef366-0a92-499c-9155-621c7ea3292a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.850896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b1c3-3373-4b4d-9c05-16dbc5b13f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.852163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b1c3-3373-4b4d-9c05-16dbc5b13f79 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.852615 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b1c3-3373-4b4d-9c05-16dbc5b13f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.853090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40b1c3-3373-4b4d-9c05-16dbc5b13f79 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.853663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d75610a-c315-4062-9bd9-26a7eadbcd0c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.854401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b1c3-3373-4b4d-9c05-16dbc5b13f79 admin admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.854860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b1c3-3373-4b4d-9c05-16dbc5b13f79 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.857001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40b1c3-3373-4b4d-9c05-16dbc5b13f79 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.868322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab90b53-9a4b-4820-ae8d-f1ae341288b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.868991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90b53-9a4b-4820-ae8d-f1ae341288b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.869267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90b53-9a4b-4820-ae8d-f1ae341288b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.869535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab90b53-9a4b-4820-ae8d-f1ae341288b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.870308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab90b53-9a4b-4820-ae8d-f1ae341288b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:47.870603 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab90b53-9a4b-4820-ae8d-f1ae341288b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.872209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab90b53-9a4b-4820-ae8d-f1ae341288b0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.881879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 280/559] 10.222.0.32 () {56 vars in 1160 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:47.895167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b1c3-3373-4b4d-9c05-16dbc5b13f79 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.896971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 280/560] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:47.907070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab90b53-9a4b-4820-ae8d-f1ae341288b0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.916554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40b1c3-3373-4b4d-9c05-16dbc5b13f79 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.917799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab90b53-9a4b-4820-ae8d-f1ae341288b0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.926607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01434fec-1066-4a32-8047-5b462a854b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.927530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92c072-7728-485e-8de3-b03e41792186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.928170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92c072-7728-485e-8de3-b03e41792186 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.928442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92c072-7728-485e-8de3-b03e41792186 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.928789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434fec-1066-4a32-8047-5b462a854b16 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.929057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434fec-1066-4a32-8047-5b462a854b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.929321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01434fec-1066-4a32-8047-5b462a854b16 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.929994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b92c072-7728-485e-8de3-b03e41792186 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.942409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92c072-7728-485e-8de3-b03e41792186 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.944283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b92c072-7728-485e-8de3-b03e41792186 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.944400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01434fec-1066-4a32-8047-5b462a854b16 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:47.946601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01434fec-1066-4a32-8047-5b462a854b16 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:47.954196 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 281/561] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:47.960582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92c072-7728-485e-8de3-b03e41792186 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.966107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-01434fec-1066-4a32-8047-5b462a854b16 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:00:47.967412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 281/562] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/users/swift => generated 83 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:47.969252 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b92c072-7728-485e-8de3-b03e41792186 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:47.978048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01434fec-1066-4a32-8047-5b462a854b16 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:47.980096 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8acdd-1a11-4f43-b725-1a61cacb99eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:47.981050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8acdd-1a11-4f43-b725-1a61cacb99eb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:47.981373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8acdd-1a11-4f43-b725-1a61cacb99eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:47.981651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8acdd-1a11-4f43-b725-1a61cacb99eb admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:47.994436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01434fec-1066-4a32-8047-5b462a854b16 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.003299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8acdd-1a11-4f43-b725-1a61cacb99eb admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.005261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8acdd-1a11-4f43-b725-1a61cacb99eb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.005388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3935c-4d86-4773-b3bb-ffb0150f10b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.006226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3935c-4d86-4773-b3bb-ffb0150f10b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.006450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3935c-4d86-4773-b3bb-ffb0150f10b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.006717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f3935c-4d86-4773-b3bb-ffb0150f10b0 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.007652 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3935c-4d86-4773-b3bb-ffb0150f10b0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:48.007958 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3935c-4d86-4773-b3bb-ffb0150f10b0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.009758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f3935c-4d86-4773-b3bb-ffb0150f10b0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.027939 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 282/563] 10.222.0.32 () {56 vars in 1156 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:48.028284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-0db8acdd-1a11-4f43-b725-1a61cacb99eb admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:48.029777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 282/564] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:47 2021] GET /identity/v3/domains/Default => generated 87 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:48.035548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3935c-4d86-4773-b3bb-ffb0150f10b0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:48.036193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8acdd-1a11-4f43-b725-1a61cacb99eb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:48.046709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f3935c-4d86-4773-b3bb-ffb0150f10b0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.047902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8acdd-1a11-4f43-b725-1a61cacb99eb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.052954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749847-aec8-4998-bea9-366fd5966249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.053110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ef8df-23ff-436c-906e-2a818b036f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.053591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749847-aec8-4998-bea9-366fd5966249 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.053842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ef8df-23ff-436c-906e-2a818b036f40 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.053941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749847-aec8-4998-bea9-366fd5966249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.054174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67749847-aec8-4998-bea9-366fd5966249 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.054268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ef8df-23ff-436c-906e-2a818b036f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.054464 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ef8df-23ff-436c-906e-2a818b036f40 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.054897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67749847-aec8-4998-bea9-366fd5966249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:48.055196 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67749847-aec8-4998-bea9-366fd5966249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.056971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67749847-aec8-4998-bea9-366fd5966249 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.065923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ef8df-23ff-436c-906e-2a818b036f40 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.067833 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ef8df-23ff-436c-906e-2a818b036f40 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.071524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 283/565] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:48.077392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749847-aec8-4998-bea9-366fd5966249 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:48.089585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67749847-aec8-4998-bea9-366fd5966249 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.090704 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-701ef8df-23ff-436c-906e-2a818b036f40 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:48.092158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 283/566] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:48 2021] GET /identity/v3/domains/Default => generated 87 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:48.093973 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6db010-1ef9-4c5e-a7a5-ba6874d4f9df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.094784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6db010-1ef9-4c5e-a7a5-ba6874d4f9df admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.095064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6db010-1ef9-4c5e-a7a5-ba6874d4f9df admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.095340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6db010-1ef9-4c5e-a7a5-ba6874d4f9df admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.098676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ef8df-23ff-436c-906e-2a818b036f40 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:48.104589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6db010-1ef9-4c5e-a7a5-ba6874d4f9df admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.106677 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6db010-1ef9-4c5e-a7a5-ba6874d4f9df admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.109144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ef8df-23ff-436c-906e-2a818b036f40 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.115355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e03ff0-a3c1-4f57-975d-cc69ffbfcddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.116146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e03ff0-a3c1-4f57-975d-cc69ffbfcddb admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.116425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e03ff0-a3c1-4f57-975d-cc69ffbfcddb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.116739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e03ff0-a3c1-4f57-975d-cc69ffbfcddb admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.117471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e03ff0-a3c1-4f57-975d-cc69ffbfcddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:48.117822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e03ff0-a3c1-4f57-975d-cc69ffbfcddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.119558 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e03ff0-a3c1-4f57-975d-cc69ffbfcddb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.123144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-fd6db010-1ef9-4c5e-a7a5-ba6874d4f9df admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:48.124679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 284/567] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:48.133389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6db010-1ef9-4c5e-a7a5-ba6874d4f9df admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:48.143235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 284/568] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:48.143790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6db010-1ef9-4c5e-a7a5-ba6874d4f9df admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.149278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5959ac-59ac-4b73-899e-0376a4ddc893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.150008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5959ac-59ac-4b73-899e-0376a4ddc893 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.150602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5959ac-59ac-4b73-899e-0376a4ddc893 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.150757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5959ac-59ac-4b73-899e-0376a4ddc893 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.151523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e03ff0-a3c1-4f57-975d-cc69ffbfcddb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:48.151679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5959ac-59ac-4b73-899e-0376a4ddc893 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:48.152094 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5959ac-59ac-4b73-899e-0376a4ddc893 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.154122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5959ac-59ac-4b73-899e-0376a4ddc893 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.162993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e03ff0-a3c1-4f57-975d-cc69ffbfcddb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.166775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 285/569] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:48.171997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed152d3-3e20-4b06-ba76-29e5d46d50ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.172885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed152d3-3e20-4b06-ba76-29e5d46d50ef admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.173148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed152d3-3e20-4b06-ba76-29e5d46d50ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.173414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed152d3-3e20-4b06-ba76-29e5d46d50ef admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.173512 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5959ac-59ac-4b73-899e-0376a4ddc893 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:48.184090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5959ac-59ac-4b73-899e-0376a4ddc893 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.184990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed152d3-3e20-4b06-ba76-29e5d46d50ef admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.188180 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed152d3-3e20-4b06-ba76-29e5d46d50ef admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.190305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2a942-27a0-464c-b78c-7bb18dfa3c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.191194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2a942-27a0-464c-b78c-7bb18dfa3c90 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.191815 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2a942-27a0-464c-b78c-7bb18dfa3c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.192085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2a942-27a0-464c-b78c-7bb18dfa3c90 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.192973 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2a942-27a0-464c-b78c-7bb18dfa3c90 admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=66c74b04afed4aabbdbee054438a4933) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:48.193327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2a942-27a0-464c-b78c-7bb18dfa3c90 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.195476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe2a942-27a0-464c-b78c-7bb18dfa3c90 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.202193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 286/570] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:48 2021] GET /identity/v3/role_assignments?user.id=66c74b04afed4aabbdbee054438a4933&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 608 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:48.202879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-0ed152d3-3e20-4b06-ba76-29e5d46d50ef admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:48.204360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 285/571] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:48 2021] GET /identity/v3/projects/service => generated 88 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:48.222788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2a942-27a0-464c-b78c-7bb18dfa3c90 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:48.232907 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2a942-27a0-464c-b78c-7bb18dfa3c90 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.238264 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7716fa0f-9afb-42ac-bf79-3c5fdc391ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.238988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716fa0f-9afb-42ac-bf79-3c5fdc391ada admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.239268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716fa0f-9afb-42ac-bf79-3c5fdc391ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.239537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7716fa0f-9afb-42ac-bf79-3c5fdc391ada admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.240394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716fa0f-9afb-42ac-bf79-3c5fdc391ada admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:48.240696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716fa0f-9afb-42ac-bf79-3c5fdc391ada admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.243005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7716fa0f-9afb-42ac-bf79-3c5fdc391ada admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.257366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 287/572] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:48 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:48.263739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed152d3-3e20-4b06-ba76-29e5d46d50ef admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:48.279785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed152d3-3e20-4b06-ba76-29e5d46d50ef admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:48.288825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb882fb-566f-443e-8d52-28b14c0998d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:48.289854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb882fb-566f-443e-8d52-28b14c0998d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:48.290164 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb882fb-566f-443e-8d52-28b14c0998d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:48.290438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb882fb-566f-443e-8d52-28b14c0998d1 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/3856a21179234c9ebcbd4a9bd7ee3945/roles/4784162e8bd0416c9bc4ef9e01acb1d9` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:48.324683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb882fb-566f-443e-8d52-28b14c0998d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=3856a21179234c9ebcbd4a9bd7ee3945, role_id=4784162e8bd0416c9bc4ef9e01acb1d9)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:48.327455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb882fb-566f-443e-8d52-28b14c0998d1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:48.416854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 286/573] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:48 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/3856a21179234c9ebcbd4a9bd7ee3945/roles/4784162e8bd0416c9bc4ef9e01acb1d9 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:49.212259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7659810-04dd-4d4f-97d8-717bf6f4e1fb None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.212893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7659810-04dd-4d4f-97d8-717bf6f4e1fb None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.212893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7659810-04dd-4d4f-97d8-717bf6f4e1fb None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.214838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 288/574] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:49.220885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2246-6af2-43c5-87a8-f5d1a3998099 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.221531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2246-6af2-43c5-87a8-f5d1a3998099 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.221855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3c2246-6af2-43c5-87a8-f5d1a3998099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.243286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-aa3c2246-6af2-43c5-87a8-f5d1a3998099 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:49.244453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-aa3c2246-6af2-43c5-87a8-f5d1a3998099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:49.308412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 287/575] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:49 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:49.368596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7659810-04dd-4d4f-97d8-717bf6f4e1fb None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.387275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7659810-04dd-4d4f-97d8-717bf6f4e1fb None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.391668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd45be-9ea2-4a00-bd21-66f49aa812a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.392498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd45be-9ea2-4a00-bd21-66f49aa812a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.392770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd45be-9ea2-4a00-bd21-66f49aa812a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.393044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd45be-9ea2-4a00-bd21-66f49aa812a1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.409280 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd45be-9ea2-4a00-bd21-66f49aa812a1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:49.416174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-25fd45be-9ea2-4a00-bd21-66f49aa812a1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:49.417533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 289/576] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:49.424445 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2246-6af2-43c5-87a8-f5d1a3998099 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.433472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3c2246-6af2-43c5-87a8-f5d1a3998099 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.446891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814bf6-6260-48d7-8788-6a5ad02303bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.447585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814bf6-6260-48d7-8788-6a5ad02303bb admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.447858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814bf6-6260-48d7-8788-6a5ad02303bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.448125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814bf6-6260-48d7-8788-6a5ad02303bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.448904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77814bf6-6260-48d7-8788-6a5ad02303bb admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:49.449202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77814bf6-6260-48d7-8788-6a5ad02303bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.450809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77814bf6-6260-48d7-8788-6a5ad02303bb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.460755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 288/577] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:49.467161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd45be-9ea2-4a00-bd21-66f49aa812a1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.478141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd45be-9ea2-4a00-bd21-66f49aa812a1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.482798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24617f09-e8f3-4f7d-b494-39a0cbe6479b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.483731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24617f09-e8f3-4f7d-b494-39a0cbe6479b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.484150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24617f09-e8f3-4f7d-b494-39a0cbe6479b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.485509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24617f09-e8f3-4f7d-b494-39a0cbe6479b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.496559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24617f09-e8f3-4f7d-b494-39a0cbe6479b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.498607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24617f09-e8f3-4f7d-b494-39a0cbe6479b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.515986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-24617f09-e8f3-4f7d-b494-39a0cbe6479b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:49.522053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 290/578] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:49.524880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814bf6-6260-48d7-8788-6a5ad02303bb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.535036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814bf6-6260-48d7-8788-6a5ad02303bb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.539722 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee002b-a6a6-403d-b493-4f2ac0662889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.540537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee002b-a6a6-403d-b493-4f2ac0662889 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.541011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee002b-a6a6-403d-b493-4f2ac0662889 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.541423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ee002b-a6a6-403d-b493-4f2ac0662889 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.542418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee002b-a6a6-403d-b493-4f2ac0662889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:49.542855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee002b-a6a6-403d-b493-4f2ac0662889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.544545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ee002b-a6a6-403d-b493-4f2ac0662889 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.557701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 289/579] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:49.564159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24617f09-e8f3-4f7d-b494-39a0cbe6479b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.574971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24617f09-e8f3-4f7d-b494-39a0cbe6479b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.579630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bfab0-7d1e-4078-8f1b-295ed2aebefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.581412 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bfab0-7d1e-4078-8f1b-295ed2aebefb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.581862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bfab0-7d1e-4078-8f1b-295ed2aebefb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.582324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9bfab0-7d1e-4078-8f1b-295ed2aebefb admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.591248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bfab0-7d1e-4078-8f1b-295ed2aebefb admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.593435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9bfab0-7d1e-4078-8f1b-295ed2aebefb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.609385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-8f9bfab0-7d1e-4078-8f1b-295ed2aebefb admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:00:49.611191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 291/580] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:49.617497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee002b-a6a6-403d-b493-4f2ac0662889 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.628406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ee002b-a6a6-403d-b493-4f2ac0662889 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.633199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74884c15-053c-438b-8bbf-d4aac2d89c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.634088 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74884c15-053c-438b-8bbf-d4aac2d89c9e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.634529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74884c15-053c-438b-8bbf-d4aac2d89c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.634964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74884c15-053c-438b-8bbf-d4aac2d89c9e admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.635938 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74884c15-053c-438b-8bbf-d4aac2d89c9e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:49.636412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74884c15-053c-438b-8bbf-d4aac2d89c9e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.638446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74884c15-053c-438b-8bbf-d4aac2d89c9e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.659021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 290/581] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:49.665382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bfab0-7d1e-4078-8f1b-295ed2aebefb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.675904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9bfab0-7d1e-4078-8f1b-295ed2aebefb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.680758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1defa-004b-4943-b26e-7d17e5973c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.681599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1defa-004b-4943-b26e-7d17e5973c73 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.682066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1defa-004b-4943-b26e-7d17e5973c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.682482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1defa-004b-4943-b26e-7d17e5973c73 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.691679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1defa-004b-4943-b26e-7d17e5973c73 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.693623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1defa-004b-4943-b26e-7d17e5973c73 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.703177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 292/582] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:49.710314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74884c15-053c-438b-8bbf-d4aac2d89c9e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.720360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74884c15-053c-438b-8bbf-d4aac2d89c9e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.725157 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb7d32-abd6-4bfe-ba88-6b84d279eac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.726178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb7d32-abd6-4bfe-ba88-6b84d279eac0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.726642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb7d32-abd6-4bfe-ba88-6b84d279eac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.727070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb7d32-abd6-4bfe-ba88-6b84d279eac0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.737810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb7d32-abd6-4bfe-ba88-6b84d279eac0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.739838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb7d32-abd6-4bfe-ba88-6b84d279eac0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.757677 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-5acb7d32-abd6-4bfe-ba88-6b84d279eac0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:49.759331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 291/583] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:49.767310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1defa-004b-4943-b26e-7d17e5973c73 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.777317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1defa-004b-4943-b26e-7d17e5973c73 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.785457 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8a075-8458-46af-a5fb-919cf6d91ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.786323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8a075-8458-46af-a5fb-919cf6d91ce0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.787557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8a075-8458-46af-a5fb-919cf6d91ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.787996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8a075-8458-46af-a5fb-919cf6d91ce0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.788901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8a075-8458-46af-a5fb-919cf6d91ce0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:49.789342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8a075-8458-46af-a5fb-919cf6d91ce0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.791084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8a075-8458-46af-a5fb-919cf6d91ce0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.808752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 293/584] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:49.815232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb7d32-abd6-4bfe-ba88-6b84d279eac0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.829113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb7d32-abd6-4bfe-ba88-6b84d279eac0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.840185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630595f-702b-4bb1-afed-683fb5acc160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.841084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630595f-702b-4bb1-afed-683fb5acc160 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.841366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630595f-702b-4bb1-afed-683fb5acc160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.841639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4630595f-702b-4bb1-afed-683fb5acc160 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.849020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630595f-702b-4bb1-afed-683fb5acc160 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.850977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4630595f-702b-4bb1-afed-683fb5acc160 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.864630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-4630595f-702b-4bb1-afed-683fb5acc160 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:49.870142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 292/585] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/projects/service => generated 88 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:49.872492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8a075-8458-46af-a5fb-919cf6d91ce0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.887413 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8a075-8458-46af-a5fb-919cf6d91ce0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.902679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb6c29e-aaab-4ff1-84f0-bb1149916612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.903338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6c29e-aaab-4ff1-84f0-bb1149916612 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.903618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6c29e-aaab-4ff1-84f0-bb1149916612 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.903892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb6c29e-aaab-4ff1-84f0-bb1149916612 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.904683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6c29e-aaab-4ff1-84f0-bb1149916612 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:49.904988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6c29e-aaab-4ff1-84f0-bb1149916612 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.906844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb6c29e-aaab-4ff1-84f0-bb1149916612 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.923078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 294/586] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:49.930804 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630595f-702b-4bb1-afed-683fb5acc160 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:49.947250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4630595f-702b-4bb1-afed-683fb5acc160 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:49.960093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f8d6d-700c-4fad-be62-9d7568fe0ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:49.961017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8d6d-700c-4fad-be62-9d7568fe0ed4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:49.961501 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8d6d-700c-4fad-be62-9d7568fe0ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:49.961947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f8d6d-700c-4fad-be62-9d7568fe0ed4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:49.963040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f8d6d-700c-4fad-be62-9d7568fe0ed4 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=0a888473e9774db39941b0610769505a, user.id=d1596a916d784f6bb6e3b876f4820903) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:49.963552 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f8d6d-700c-4fad-be62-9d7568fe0ed4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:49.965613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f8d6d-700c-4fad-be62-9d7568fe0ed4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:49.974498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 293/587] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:49 2021] GET /identity/v3/role_assignments?user.id=d1596a916d784f6bb6e3b876f4820903&scope.project.id=0a888473e9774db39941b0610769505a&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 259 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:50.090488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c46c4-c51e-4eff-9bbd-fbea650f6935 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.090672 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c46c4-c51e-4eff-9bbd-fbea650f6935 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.090940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70c46c4-c51e-4eff-9bbd-fbea650f6935 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.093126 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 295/588] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:50.099384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e789a-7752-4c2c-bb36-e715c36b3423 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.099664 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e789a-7752-4c2c-bb36-e715c36b3423 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.099935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8e789a-7752-4c2c-bb36-e715c36b3423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.128609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-6f8e789a-7752-4c2c-bb36-e715c36b3423 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:50.129792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6f8e789a-7752-4c2c-bb36-e715c36b3423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:50.141565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 294/589] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:50.168272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c46c4-c51e-4eff-9bbd-fbea650f6935 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:50.186051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70c46c4-c51e-4eff-9bbd-fbea650f6935 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:50.192065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16724e-76f4-479f-b158-6e0928862931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:50.192870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16724e-76f4-479f-b158-6e0928862931 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.193140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16724e-76f4-479f-b158-6e0928862931 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.193410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16724e-76f4-479f-b158-6e0928862931 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.210699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16724e-76f4-479f-b158-6e0928862931 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:50.212548 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d16724e-76f4-479f-b158-6e0928862931 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:50.234731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-2d16724e-76f4-479f-b158-6e0928862931 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:50.236398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 296/590] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:50 2021] GET /identity/v3/domains/Default => generated 87 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:50.242528 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e789a-7752-4c2c-bb36-e715c36b3423 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:50.260525 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8e789a-7752-4c2c-bb36-e715c36b3423 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:50.274849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1403d3f-2b5a-40df-b4c4-9bdfcba6c64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:50.275538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1403d3f-2b5a-40df-b4c4-9bdfcba6c64d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.275838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1403d3f-2b5a-40df-b4c4-9bdfcba6c64d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.276091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1403d3f-2b5a-40df-b4c4-9bdfcba6c64d admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.276838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1403d3f-2b5a-40df-b4c4-9bdfcba6c64d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:50.277141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1403d3f-2b5a-40df-b4c4-9bdfcba6c64d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:50.278751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1403d3f-2b5a-40df-b4c4-9bdfcba6c64d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:50.295630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 295/591] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:50 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:50.302818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16724e-76f4-479f-b158-6e0928862931 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:50.315377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16724e-76f4-479f-b158-6e0928862931 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:50.326402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f15b2b-e8f2-48a6-8f34-eb7df9f9d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:50.327084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15b2b-e8f2-48a6-8f34-eb7df9f9d1bc admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.327357 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15b2b-e8f2-48a6-8f34-eb7df9f9d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.327622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f15b2b-e8f2-48a6-8f34-eb7df9f9d1bc admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.328366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f15b2b-e8f2-48a6-8f34-eb7df9f9d1bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:50.330375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f15b2b-e8f2-48a6-8f34-eb7df9f9d1bc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:50.425265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 297/592] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:00:50 2021] POST /identity/v3/users => generated 254 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:00:50.727429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6034b62-a53f-4b22-846e-25049954e925 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.728103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6034b62-a53f-4b22-846e-25049954e925 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.728592 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6034b62-a53f-4b22-846e-25049954e925 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.730661 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 296/593] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:50.737771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94a496-10f2-4fb8-b86d-12ff920b7f67 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.738491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94a496-10f2-4fb8-b86d-12ff920b7f67 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.739153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94a496-10f2-4fb8-b86d-12ff920b7f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.758591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8f94a496-10f2-4fb8-b86d-12ff920b7f67 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:50.760115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8f94a496-10f2-4fb8-b86d-12ff920b7f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:50.774153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 298/594] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:50 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:50.793036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6034b62-a53f-4b22-846e-25049954e925 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:50.810957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6034b62-a53f-4b22-846e-25049954e925 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:50.818162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:50.819303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.819832 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.820327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.821244 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:50.822531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:50.822531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:50.822531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:50.823789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:50.838766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:00:50.844010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 297/595] 10.222.0.32 () {56 vars in 1150 bytes} [Wed Oct 27 01:00:50 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:50.851547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94a496-10f2-4fb8-b86d-12ff920b7f67 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:50.862835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94a496-10f2-4fb8-b86d-12ff920b7f67 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:50.867779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c182-815a-406a-8df3-22e42932414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:50.868730 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c182-815a-406a-8df3-22e42932414e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.869211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c182-815a-406a-8df3-22e42932414e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.869683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c182-815a-406a-8df3-22e42932414e admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.870707 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c182-815a-406a-8df3-22e42932414e admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:50.871213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c182-815a-406a-8df3-22e42932414e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:50.872489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-fa42c182-815a-406a-8df3-22e42932414e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:50.872489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:00:50.872489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:00:50.873683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c182-815a-406a-8df3-22e42932414e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:50.884809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 299/596] 10.222.0.32 () {56 vars in 1145 bytes} [Wed Oct 27 01:00:50 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:50.886431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:50.897457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78091ce1-272f-4509-a961-c62e4e4cf60b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:50.902696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393da541-b31b-4f8a-a7cc-30a2c6adfb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:50.903568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da541-b31b-4f8a-a7cc-30a2c6adfb9c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:50.904083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da541-b31b-4f8a-a7cc-30a2c6adfb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:50.904568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393da541-b31b-4f8a-a7cc-30a2c6adfb9c admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:50.905637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da541-b31b-4f8a-a7cc-30a2c6adfb9c admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:50.906178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da541-b31b-4f8a-a7cc-30a2c6adfb9c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:50.907414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-393da541-b31b-4f8a-a7cc-30a2c6adfb9c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_services failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:50.907414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:50.907414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:50.909323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393da541-b31b-4f8a-a7cc-30a2c6adfb9c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:50.920030 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 298/597] 10.222.0.32 () {56 vars in 1145 bytes} [Wed Oct 27 01:00:50 2021] GET /identity/v3/services?type=block-storage => generated 130 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:51.294133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2cef5-c7b1-42ec-99d6-f71d43f8c141 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.295103 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2cef5-c7b1-42ec-99d6-f71d43f8c141 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.295574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2cef5-c7b1-42ec-99d6-f71d43f8c141 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.297871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 300/598] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:51 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:51.304969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634889-bf70-4d20-a71b-3ee78abc1e93 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.305899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634889-bf70-4d20-a71b-3ee78abc1e93 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.306409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22634889-bf70-4d20-a71b-3ee78abc1e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.334101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-22634889-bf70-4d20-a71b-3ee78abc1e93 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:51.334101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-22634889-bf70-4d20-a71b-3ee78abc1e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:51.343893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 299/599] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:51.392239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2cef5-c7b1-42ec-99d6-f71d43f8c141 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.415659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2cef5-c7b1-42ec-99d6-f71d43f8c141 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.420491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cbcc4-668a-480e-8e6a-300d227f1df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.421538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cbcc4-668a-480e-8e6a-300d227f1df4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.422005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cbcc4-668a-480e-8e6a-300d227f1df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.422489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cbcc4-668a-480e-8e6a-300d227f1df4 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.439035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cbcc4-668a-480e-8e6a-300d227f1df4 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:51.446717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-bc4cbcc4-668a-480e-8e6a-300d227f1df4 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:51.447904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 301/600] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/roles/service => generated 85 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:51.454656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22634889-bf70-4d20-a71b-3ee78abc1e93 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.467001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22634889-bf70-4d20-a71b-3ee78abc1e93 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.474956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c70a4-bcb8-4bc6-a322-d5308ba7d398 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.475238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c70a4-bcb8-4bc6-a322-d5308ba7d398 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.475505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c70a4-bcb8-4bc6-a322-d5308ba7d398 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.476068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487bfc-7b6d-46cc-9842-e02e50c7cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.476726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487bfc-7b6d-46cc-9842-e02e50c7cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.477002 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487bfc-7b6d-46cc-9842-e02e50c7cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.477268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09487bfc-7b6d-46cc-9842-e02e50c7cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.477635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 302/601] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:51 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:51.478078 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09487bfc-7b6d-46cc-9842-e02e50c7cd2d admin admin] RBAC: Adding query filter params (name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:51.478383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09487bfc-7b6d-46cc-9842-e02e50c7cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.480026 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09487bfc-7b6d-46cc-9842-e02e50c7cd2d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.488572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d070c-1e6c-4fd1-8d76-e71eb7384a69 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.488852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d070c-1e6c-4fd1-8d76-e71eb7384a69 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.489122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645d070c-1e6c-4fd1-8d76-e71eb7384a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.498084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 300/602] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:51.503511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487bfc-7b6d-46cc-9842-e02e50c7cd2d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.520442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09487bfc-7b6d-46cc-9842-e02e50c7cd2d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.524513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-645d070c-1e6c-4fd1-8d76-e71eb7384a69 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:51.526069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-645d070c-1e6c-4fd1-8d76-e71eb7384a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:51.531310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310158f-04ea-47e5-8552-2bb494c7b90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.532089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310158f-04ea-47e5-8552-2bb494c7b90f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.532409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310158f-04ea-47e5-8552-2bb494c7b90f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.532680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e310158f-04ea-47e5-8552-2bb494c7b90f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.542343 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 303/603] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:51 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:51.554589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310158f-04ea-47e5-8552-2bb494c7b90f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.556390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e310158f-04ea-47e5-8552-2bb494c7b90f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.583405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e310158f-04ea-47e5-8552-2bb494c7b90f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:51.584894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 301/604] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 82 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:51.591084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d070c-1e6c-4fd1-8d76-e71eb7384a69 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.594734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310158f-04ea-47e5-8552-2bb494c7b90f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.605494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e310158f-04ea-47e5-8552-2bb494c7b90f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.609908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645d070c-1e6c-4fd1-8d76-e71eb7384a69 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.610314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c83e0-b612-47a0-8434-6248c44bca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.611678 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c83e0-b612-47a0-8434-6248c44bca05 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.611954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c83e0-b612-47a0-8434-6248c44bca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.612214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9c83e0-b612-47a0-8434-6248c44bca05 admin admin] PATH_INFO: `/v3/services/network` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.612972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c83e0-b612-47a0-8434-6248c44bca05 admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.614660 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9c83e0-b612-47a0-8434-6248c44bca05 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.623943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b0503-0ea7-463b-add8-b9e6d4b35c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.624597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0503-0ea7-463b-add8-b9e6d4b35c1f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.624874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0503-0ea7-463b-add8-b9e6d4b35c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.625141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2b0503-0ea7-463b-add8-b9e6d4b35c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.625882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0503-0ea7-463b-add8-b9e6d4b35c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:51.626062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-6d9c83e0-b612-47a0-8434-6248c44bca05 admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:00:51.626210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0503-0ea7-463b-add8-b9e6d4b35c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.628059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 302/605] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/services/network => generated 88 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:51.629340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2b0503-0ea7-463b-add8-b9e6d4b35c1f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.634259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c83e0-b612-47a0-8434-6248c44bca05 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.645257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9c83e0-b612-47a0-8434-6248c44bca05 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.655840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f628ed3-d625-4529-ae55-30806a443c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.658626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f628ed3-d625-4529-ae55-30806a443c01 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.658873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f628ed3-d625-4529-ae55-30806a443c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.659909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f628ed3-d625-4529-ae55-30806a443c01 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.660747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 304/606] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:51.660920 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f628ed3-d625-4529-ae55-30806a443c01 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:51.661198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f628ed3-d625-4529-ae55-30806a443c01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.662802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f628ed3-d625-4529-ae55-30806a443c01 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.666537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b0503-0ea7-463b-add8-b9e6d4b35c1f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.671956 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 303/607] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/services?name=network => generated 124 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:51.680092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f628ed3-d625-4529-ae55-30806a443c01 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.682150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2b0503-0ea7-463b-add8-b9e6d4b35c1f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.686807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26012dec-6c83-4173-8748-5e0c50d7fedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.687737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26012dec-6c83-4173-8748-5e0c50d7fedf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.688061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26012dec-6c83-4173-8748-5e0c50d7fedf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.688331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26012dec-6c83-4173-8748-5e0c50d7fedf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.696969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f628ed3-d625-4529-ae55-30806a443c01 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.698188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26012dec-6c83-4173-8748-5e0c50d7fedf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.700338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26012dec-6c83-4173-8748-5e0c50d7fedf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.707041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b88ab4-56d0-4bfe-bace-45f22e660e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.708940 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b88ab4-56d0-4bfe-bace-45f22e660e46 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.709219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b88ab4-56d0-4bfe-bace-45f22e660e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.709535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b88ab4-56d0-4bfe-bace-45f22e660e46 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.711400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b88ab4-56d0-4bfe-bace-45f22e660e46 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:51.712445 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b88ab4-56d0-4bfe-bace-45f22e660e46 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.713976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b88ab4-56d0-4bfe-bace-45f22e660e46 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.730397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 304/608] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/services?type=network => generated 124 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:51.731255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-26012dec-6c83-4173-8748-5e0c50d7fedf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:00:51.732703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 305/609] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/users/swift => generated 83 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:51.739840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b88ab4-56d0-4bfe-bace-45f22e660e46 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.749791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b88ab4-56d0-4bfe-bace-45f22e660e46 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.758670 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7e9c3-97d1-4a60-a313-fe1fe497b8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.759398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7e9c3-97d1-4a60-a313-fe1fe497b8dc admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.759671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7e9c3-97d1-4a60-a313-fe1fe497b8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.759936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7e9c3-97d1-4a60-a313-fe1fe497b8dc admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.760889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7e9c3-97d1-4a60-a313-fe1fe497b8dc admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:51.761288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7e9c3-97d1-4a60-a313-fe1fe497b8dc admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.763209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7e9c3-97d1-4a60-a313-fe1fe497b8dc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.791187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 305/610] 10.222.0.32 () {56 vars in 1156 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:51.797917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26012dec-6c83-4173-8748-5e0c50d7fedf admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.809590 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26012dec-6c83-4173-8748-5e0c50d7fedf admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.814905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e60680-9c24-4d83-b37b-9bccbf49cb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.815742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e60680-9c24-4d83-b37b-9bccbf49cb72 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.816071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e60680-9c24-4d83-b37b-9bccbf49cb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.816338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e60680-9c24-4d83-b37b-9bccbf49cb72 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.825706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e60680-9c24-4d83-b37b-9bccbf49cb72 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.827517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e60680-9c24-4d83-b37b-9bccbf49cb72 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.838983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 306/611] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:51.847272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7e9c3-97d1-4a60-a313-fe1fe497b8dc admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.857597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7e9c3-97d1-4a60-a313-fe1fe497b8dc admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.866866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8118e-6d17-40cc-90e4-ef62bdafcf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.867522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8118e-6d17-40cc-90e4-ef62bdafcf85 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.867796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8118e-6d17-40cc-90e4-ef62bdafcf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.868115 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf8118e-6d17-40cc-90e4-ef62bdafcf85 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.880048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8118e-6d17-40cc-90e4-ef62bdafcf85 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.882014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf8118e-6d17-40cc-90e4-ef62bdafcf85 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.918185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-4cf8118e-6d17-40cc-90e4-ef62bdafcf85 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:51.919756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 306/612] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:51.927172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e60680-9c24-4d83-b37b-9bccbf49cb72 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.939524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e60680-9c24-4d83-b37b-9bccbf49cb72 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:51.950080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bab5cb-6733-459a-beac-1b347a2a6fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:51.950749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bab5cb-6733-459a-beac-1b347a2a6fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:51.951029 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bab5cb-6733-459a-beac-1b347a2a6fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:51.951302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bab5cb-6733-459a-beac-1b347a2a6fb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:51.952038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bab5cb-6733-459a-beac-1b347a2a6fb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:51.952340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bab5cb-6733-459a-beac-1b347a2a6fb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:51.953937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bab5cb-6733-459a-beac-1b347a2a6fb0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:51.976570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 307/613] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:51.987475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8118e-6d17-40cc-90e4-ef62bdafcf85 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:51.998204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf8118e-6d17-40cc-90e4-ef62bdafcf85 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:52.005955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ca935-708d-441d-9fdd-fd6e86b4c0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:52.006838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ca935-708d-441d-9fdd-fd6e86b4c0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.007111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ca935-708d-441d-9fdd-fd6e86b4c0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.007379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ca935-708d-441d-9fdd-fd6e86b4c0f6 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.018363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ca935-708d-441d-9fdd-fd6e86b4c0f6 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:52.020335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ca935-708d-441d-9fdd-fd6e86b4c0f6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:52.037492 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-6f4ca935-708d-441d-9fdd-fd6e86b4c0f6 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:52.040471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 307/614] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:51 2021] GET /identity/v3/projects/service => generated 88 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:52.046717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bab5cb-6733-459a-beac-1b347a2a6fb0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:52.059342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bab5cb-6733-459a-beac-1b347a2a6fb0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:52.067888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9dd538-4521-49e5-973c-cca1f7b85104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:52.068895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dd538-4521-49e5-973c-cca1f7b85104 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.069375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dd538-4521-49e5-973c-cca1f7b85104 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.069859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9dd538-4521-49e5-973c-cca1f7b85104 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.070889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dd538-4521-49e5-973c-cca1f7b85104 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:52.071393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dd538-4521-49e5-973c-cca1f7b85104 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:52.073400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9dd538-4521-49e5-973c-cca1f7b85104 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:52.087015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 308/615] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:52 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:52.093893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ca935-708d-441d-9fdd-fd6e86b4c0f6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:52.104961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ca935-708d-441d-9fdd-fd6e86b4c0f6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:52.110319 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72c985-9c8c-43a0-a890-d8c0fd67eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:52.111327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72c985-9c8c-43a0-a890-d8c0fd67eaf5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.111843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72c985-9c8c-43a0-a890-d8c0fd67eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.112308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72c985-9c8c-43a0-a890-d8c0fd67eaf5 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.113397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72c985-9c8c-43a0-a890-d8c0fd67eaf5 admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=3856a21179234c9ebcbd4a9bd7ee3945) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:52.114288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72c985-9c8c-43a0-a890-d8c0fd67eaf5 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:52.116407 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72c985-9c8c-43a0-a890-d8c0fd67eaf5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:52.123185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 308/616] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:52 2021] GET /identity/v3/role_assignments?user.id=3856a21179234c9ebcbd4a9bd7ee3945&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:52.595916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59689b-5427-4b05-bb17-863488c623df None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.596925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59689b-5427-4b05-bb17-863488c623df None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.597406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59689b-5427-4b05-bb17-863488c623df None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.599764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 309/617] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:52 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:52.606273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fd409-dd78-44f9-b6c4-3af91418fd5d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.607128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fd409-dd78-44f9-b6c4-3af91418fd5d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.607605 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fd409-dd78-44f9-b6c4-3af91418fd5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.629853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-038fd409-dd78-44f9-b6c4-3af91418fd5d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:52.631388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-038fd409-dd78-44f9-b6c4-3af91418fd5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:52.644285 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 309/618] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:52 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:52.668888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59689b-5427-4b05-bb17-863488c623df None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:52.682740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59689b-5427-4b05-bb17-863488c623df None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:52.690463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b294-670e-44c7-bbbd-906cae07c0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:52.691496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b294-670e-44c7-bbbd-906cae07c0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.691975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b294-670e-44c7-bbbd-906cae07c0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.692461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6031b294-670e-44c7-bbbd-906cae07c0f8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.707662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6031b294-670e-44c7-bbbd-906cae07c0f8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:52.714880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-6031b294-670e-44c7-bbbd-906cae07c0f8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:52.716560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 310/619] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:52 2021] GET /identity/v3/roles/admin => generated 83 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:52.723109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fd409-dd78-44f9-b6c4-3af91418fd5d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:52.732459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fd409-dd78-44f9-b6c4-3af91418fd5d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:52.739292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5892e-6af1-47fe-9ac1-f788cb531a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:52.740179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5892e-6af1-47fe-9ac1-f788cb531a18 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.740655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5892e-6af1-47fe-9ac1-f788cb531a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.741122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5892e-6af1-47fe-9ac1-f788cb531a18 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.742124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5892e-6af1-47fe-9ac1-f788cb531a18 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:52.742625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5892e-6af1-47fe-9ac1-f788cb531a18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:52.744516 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5892e-6af1-47fe-9ac1-f788cb531a18 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:52.756768 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 310/620] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:52 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:52.763256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b294-670e-44c7-bbbd-906cae07c0f8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:52.775042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6031b294-670e-44c7-bbbd-906cae07c0f8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:52.780996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b567-477e-4a1e-b07b-2e8ceb75510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:52.782062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b567-477e-4a1e-b07b-2e8ceb75510c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.782560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b567-477e-4a1e-b07b-2e8ceb75510c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.783105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61b567-477e-4a1e-b07b-2e8ceb75510c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.794308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61b567-477e-4a1e-b07b-2e8ceb75510c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:52.796455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61b567-477e-4a1e-b07b-2e8ceb75510c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:52.814881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-8b61b567-477e-4a1e-b07b-2e8ceb75510c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:52.816724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 311/621] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:52 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:52.822999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5892e-6af1-47fe-9ac1-f788cb531a18 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:52.833152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5892e-6af1-47fe-9ac1-f788cb531a18 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:52.838173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59633e-cd07-4ba6-90a2-b5fa5f90524d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:52.839099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59633e-cd07-4ba6-90a2-b5fa5f90524d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.839625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59633e-cd07-4ba6-90a2-b5fa5f90524d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.840107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e59633e-cd07-4ba6-90a2-b5fa5f90524d admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.841102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59633e-cd07-4ba6-90a2-b5fa5f90524d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:52.841602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59633e-cd07-4ba6-90a2-b5fa5f90524d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:52.843437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e59633e-cd07-4ba6-90a2-b5fa5f90524d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:52.856416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 311/622] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:52.863308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b567-477e-4a1e-b07b-2e8ceb75510c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:52.879561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61b567-477e-4a1e-b07b-2e8ceb75510c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:52.890181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64537a-c535-4d72-9cc3-a4ef60f3a03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:52.890962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64537a-c535-4d72-9cc3-a4ef60f3a03a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.891244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64537a-c535-4d72-9cc3-a4ef60f3a03a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.891513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c64537a-c535-4d72-9cc3-a4ef60f3a03a admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.905288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64537a-c535-4d72-9cc3-a4ef60f3a03a admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:52.907310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c64537a-c535-4d72-9cc3-a4ef60f3a03a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:52.924118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-9c64537a-c535-4d72-9cc3-a4ef60f3a03a admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:00:52.925594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 312/623] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Oct 27 01:00:52 2021] GET /identity/v3/users/nova => generated 82 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:52.931997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59633e-cd07-4ba6-90a2-b5fa5f90524d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:52.946995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e59633e-cd07-4ba6-90a2-b5fa5f90524d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:52.956521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1ee14-25b2-4f70-a89c-ce03d874c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:52.957493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1ee14-25b2-4f70-a89c-ce03d874c7ca admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:52.957970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1ee14-25b2-4f70-a89c-ce03d874c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:52.958561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a1ee14-25b2-4f70-a89c-ce03d874c7ca admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:52.959607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1ee14-25b2-4f70-a89c-ce03d874c7ca admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:52.960139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1ee14-25b2-4f70-a89c-ce03d874c7ca admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:52.962236 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a1ee14-25b2-4f70-a89c-ce03d874c7ca admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:53.000807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 312/624] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Oct 27 01:00:52 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:53.007853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64537a-c535-4d72-9cc3-a4ef60f3a03a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:53.023325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c64537a-c535-4d72-9cc3-a4ef60f3a03a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:53.031536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c20c4-0ea2-49ba-991b-36d2c61f344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:53.032318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c20c4-0ea2-49ba-991b-36d2c61f344b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.032593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c20c4-0ea2-49ba-991b-36d2c61f344b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.032911 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c20c4-0ea2-49ba-991b-36d2c61f344b admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.048934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c20c4-0ea2-49ba-991b-36d2c61f344b admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:53.050977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c20c4-0ea2-49ba-991b-36d2c61f344b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:53.080199 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-612c20c4-0ea2-49ba-991b-36d2c61f344b admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:53.081416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 313/625] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:53.087855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1ee14-25b2-4f70-a89c-ce03d874c7ca admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:53.107055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a1ee14-25b2-4f70-a89c-ce03d874c7ca admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:53.114788 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ae0c5-f15a-462d-897e-6bd95a0ffb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:53.115449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ae0c5-f15a-462d-897e-6bd95a0ffb37 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.115738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ae0c5-f15a-462d-897e-6bd95a0ffb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.115994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ae0c5-f15a-462d-897e-6bd95a0ffb37 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.116725 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ae0c5-f15a-462d-897e-6bd95a0ffb37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:53.117024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ae0c5-f15a-462d-897e-6bd95a0ffb37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:53.118613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10ae0c5-f15a-462d-897e-6bd95a0ffb37 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:53.143233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 313/626] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:53.149605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c20c4-0ea2-49ba-991b-36d2c61f344b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:53.163831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c20c4-0ea2-49ba-991b-36d2c61f344b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:53.175113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d029-4c93-4ab3-8a1d-2f0a161bd374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:53.175910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d029-4c93-4ab3-8a1d-2f0a161bd374 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.176193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d029-4c93-4ab3-8a1d-2f0a161bd374 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.176469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4d029-4c93-4ab3-8a1d-2f0a161bd374 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.191145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4d029-4c93-4ab3-8a1d-2f0a161bd374 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:53.193096 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4d029-4c93-4ab3-8a1d-2f0a161bd374 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:53.213574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-87e4d029-4c93-4ab3-8a1d-2f0a161bd374 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:53.218126 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 314/627] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:53 2021] GET /identity/v3/projects/service => generated 88 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:53.221922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ae0c5-f15a-462d-897e-6bd95a0ffb37 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:53.240362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ae0c5-f15a-462d-897e-6bd95a0ffb37 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:53.250187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cce80a-d3ea-4eb9-aeaa-7a996b6139cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:53.250846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cce80a-d3ea-4eb9-aeaa-7a996b6139cf admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.251124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cce80a-d3ea-4eb9-aeaa-7a996b6139cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.251397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cce80a-d3ea-4eb9-aeaa-7a996b6139cf admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.252250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cce80a-d3ea-4eb9-aeaa-7a996b6139cf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:53.252555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cce80a-d3ea-4eb9-aeaa-7a996b6139cf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:53.254411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cce80a-d3ea-4eb9-aeaa-7a996b6139cf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:53.275545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 314/628] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:53 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:53.282105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d029-4c93-4ab3-8a1d-2f0a161bd374 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:53.301020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4d029-4c93-4ab3-8a1d-2f0a161bd374 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:53.315359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d847653-5e81-4b24-b69e-d5e3178a576e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:53.316259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d847653-5e81-4b24-b69e-d5e3178a576e admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.316541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d847653-5e81-4b24-b69e-d5e3178a576e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.316818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d847653-5e81-4b24-b69e-d5e3178a576e admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/d1596a916d784f6bb6e3b876f4820903/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.318897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d847653-5e81-4b24-b69e-d5e3178a576e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=d1596a916d784f6bb6e3b876f4820903, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:53.321516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d847653-5e81-4b24-b69e-d5e3178a576e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:53.432147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 315/629] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:53 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/d1596a916d784f6bb6e3b876f4820903/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:53.638430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa35230-23f7-4950-9b96-d939b78b4085 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.638430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa35230-23f7-4950-9b96-d939b78b4085 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.638430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa35230-23f7-4950-9b96-d939b78b4085 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.641457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 315/630] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:53.648614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e07f57-43a6-4406-aea7-431dfe35d620 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.652326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e07f57-43a6-4406-aea7-431dfe35d620 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.652326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e07f57-43a6-4406-aea7-431dfe35d620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.671937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-56e07f57-43a6-4406-aea7-431dfe35d620 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:53.673565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-56e07f57-43a6-4406-aea7-431dfe35d620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:53.751092 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 316/631] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:53.777304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa35230-23f7-4950-9b96-d939b78b4085 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:53.794726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa35230-23f7-4950-9b96-d939b78b4085 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:53.800082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625990d-0a47-475f-9a09-f29d192d2ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:53.801183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625990d-0a47-475f-9a09-f29d192d2ba1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.801700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625990d-0a47-475f-9a09-f29d192d2ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.802239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625990d-0a47-475f-9a09-f29d192d2ba1 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.813909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625990d-0a47-475f-9a09-f29d192d2ba1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:53.821596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-a625990d-0a47-475f-9a09-f29d192d2ba1 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:53.823417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 316/632] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:53 2021] GET /identity/v3/roles/service => generated 85 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:53.829488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e07f57-43a6-4406-aea7-431dfe35d620 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:53.843387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e07f57-43a6-4406-aea7-431dfe35d620 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:53.850641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d34cc9-a703-49da-ad8f-e6743cf832a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:53.851308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d34cc9-a703-49da-ad8f-e6743cf832a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.851578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d34cc9-a703-49da-ad8f-e6743cf832a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.851901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d34cc9-a703-49da-ad8f-e6743cf832a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.852666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d34cc9-a703-49da-ad8f-e6743cf832a5 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:53.852963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d34cc9-a703-49da-ad8f-e6743cf832a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:53.854710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d34cc9-a703-49da-ad8f-e6743cf832a5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:53.864406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 317/633] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:53 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:53.865112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ca7c-3b15-49db-ba26-a387fa2dab41 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.865633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ca7c-3b15-49db-ba26-a387fa2dab41 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.865979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ca7c-3b15-49db-ba26-a387fa2dab41 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.867982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 317/634] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:53 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:53.871311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d34cc9-a703-49da-ad8f-e6743cf832a5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:53.875469 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5f3c4-03bd-408d-81d8-d21210eaf6a3 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.875820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5f3c4-03bd-408d-81d8-d21210eaf6a3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.876184 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5f3c4-03bd-408d-81d8-d21210eaf6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.887389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d34cc9-a703-49da-ad8f-e6743cf832a5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:53.893317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf580e-83a9-4f5e-8896-1ca8d7b1b2aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:53.894344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf580e-83a9-4f5e-8896-1ca8d7b1b2aa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.894916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf580e-83a9-4f5e-8896-1ca8d7b1b2aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.895359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccf580e-83a9-4f5e-8896-1ca8d7b1b2aa admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.895834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-23e5f3c4-03bd-408d-81d8-d21210eaf6a3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:53.897125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-23e5f3c4-03bd-408d-81d8-d21210eaf6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:53.916931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 318/635] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:53 2021] POST /identity/v3/auth/tokens => generated 1067 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:53.923219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf580e-83a9-4f5e-8896-1ca8d7b1b2aa admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:53.925555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccf580e-83a9-4f5e-8896-1ca8d7b1b2aa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:53.944515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-eccf580e-83a9-4f5e-8896-1ca8d7b1b2aa admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:53.946096 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 318/636] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:53 2021] GET /identity/v3/domains/Default => generated 87 bytes in 75 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:53.951837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5f3c4-03bd-408d-81d8-d21210eaf6a3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:53.967075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5f3c4-03bd-408d-81d8-d21210eaf6a3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:53.976245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee50e6-fd49-447d-921b-5473292b4de6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:53.976906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee50e6-fd49-447d-921b-5473292b4de6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:53.977184 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee50e6-fd49-447d-921b-5473292b4de6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:53.977457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ee50e6-fd49-447d-921b-5473292b4de6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:53.978273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee50e6-fd49-447d-921b-5473292b4de6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:53.978573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee50e6-fd49-447d-921b-5473292b4de6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:53.980255 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ee50e6-fd49-447d-921b-5473292b4de6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.005211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf580e-83a9-4f5e-8896-1ca8d7b1b2aa admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.016547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccf580e-83a9-4f5e-8896-1ca8d7b1b2aa admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.023682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54160758-d0a8-4895-a367-96cfa2820ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.025564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54160758-d0a8-4895-a367-96cfa2820ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.025845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54160758-d0a8-4895-a367-96cfa2820ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.026138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54160758-d0a8-4895-a367-96cfa2820ef1 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.027015 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 319/637] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:54.027228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54160758-d0a8-4895-a367-96cfa2820ef1 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.028251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-54160758-d0a8-4895-a367-96cfa2820ef1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:54.028251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:00:54.028251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:00:54.029249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54160758-d0a8-4895-a367-96cfa2820ef1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.030590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee50e6-fd49-447d-921b-5473292b4de6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.045000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ee50e6-fd49-447d-921b-5473292b4de6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.049852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a1eb-aef9-4d70-82f5-789eaece723b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.050788 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a1eb-aef9-4d70-82f5-789eaece723b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.051067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a1eb-aef9-4d70-82f5-789eaece723b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.051340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71a1eb-aef9-4d70-82f5-789eaece723b admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.059894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71a1eb-aef9-4d70-82f5-789eaece723b admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.062060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71a1eb-aef9-4d70-82f5-789eaece723b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.077109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-db71a1eb-aef9-4d70-82f5-789eaece723b admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:00:54.078831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 320/638] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:00:54 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:54.085444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a1eb-aef9-4d70-82f5-789eaece723b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.096330 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71a1eb-aef9-4d70-82f5-789eaece723b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.100891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b99a-b1c9-4b99-9767-719e90fe3b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.101587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b99a-b1c9-4b99-9767-719e90fe3b9e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.101902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b99a-b1c9-4b99-9767-719e90fe3b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.102211 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8b99a-b1c9-4b99-9767-719e90fe3b9e admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.103132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8b99a-b1c9-4b99-9767-719e90fe3b9e admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:54.103505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8b99a-b1c9-4b99-9767-719e90fe3b9e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.105355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8b99a-b1c9-4b99-9767-719e90fe3b9e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.124767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 321/639] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Oct 27 01:00:54 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:54.131793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b99a-b1c9-4b99-9767-719e90fe3b9e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.141873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8b99a-b1c9-4b99-9767-719e90fe3b9e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.147798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b6869-7f6e-4a55-82c0-4b46f7dbf531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.148485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b6869-7f6e-4a55-82c0-4b46f7dbf531 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.148766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b6869-7f6e-4a55-82c0-4b46f7dbf531 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.149041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b6869-7f6e-4a55-82c0-4b46f7dbf531 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.157888 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b6869-7f6e-4a55-82c0-4b46f7dbf531 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.159803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0b6869-7f6e-4a55-82c0-4b46f7dbf531 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.169288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 322/640] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:54 2021] GET /identity/v3/auth/tokens => generated 1067 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:54.175627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b6869-7f6e-4a55-82c0-4b46f7dbf531 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.179580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 319/641] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:00:53 2021] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:00:54.185075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b6869-7f6e-4a55-82c0-4b46f7dbf531 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.212364 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766110fc-7fd9-4723-a6f0-6972d2beb57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.213169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766110fc-7fd9-4723-a6f0-6972d2beb57f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.213494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766110fc-7fd9-4723-a6f0-6972d2beb57f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.213766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766110fc-7fd9-4723-a6f0-6972d2beb57f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.225701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766110fc-7fd9-4723-a6f0-6972d2beb57f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.227726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766110fc-7fd9-4723-a6f0-6972d2beb57f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.245461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-766110fc-7fd9-4723-a6f0-6972d2beb57f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:54.247079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 323/642] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:54 2021] GET /identity/v3/domains/Default => generated 87 bytes in 72 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:54.254074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54160758-d0a8-4895-a367-96cfa2820ef1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.279342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54160758-d0a8-4895-a367-96cfa2820ef1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.288698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28c38-49e9-4ad7-a0f4-5f1c46b2bdbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.289385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28c38-49e9-4ad7-a0f4-5f1c46b2bdbe admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.289662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28c38-49e9-4ad7-a0f4-5f1c46b2bdbe admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.289933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a28c38-49e9-4ad7-a0f4-5f1c46b2bdbe admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.290710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28c38-49e9-4ad7-a0f4-5f1c46b2bdbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:54.291017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28c38-49e9-4ad7-a0f4-5f1c46b2bdbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.292650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a28c38-49e9-4ad7-a0f4-5f1c46b2bdbe admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.316801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 320/643] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:54 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:54.323116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766110fc-7fd9-4723-a6f0-6972d2beb57f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.337320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766110fc-7fd9-4723-a6f0-6972d2beb57f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.342308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2220b-fd91-40a0-a9c9-6c05d2851542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.343295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2220b-fd91-40a0-a9c9-6c05d2851542 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.343786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2220b-fd91-40a0-a9c9-6c05d2851542 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.344212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2220b-fd91-40a0-a9c9-6c05d2851542 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.363331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2220b-fd91-40a0-a9c9-6c05d2851542 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.365293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2220b-fd91-40a0-a9c9-6c05d2851542 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.387580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-58d2220b-fd91-40a0-a9c9-6c05d2851542 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:54.389331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 324/644] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:54 2021] GET /identity/v3/projects/service => generated 88 bytes in 67 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:54.395962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28c38-49e9-4ad7-a0f4-5f1c46b2bdbe admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.416105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a28c38-49e9-4ad7-a0f4-5f1c46b2bdbe admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.428021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3f9dbd-ee96-4ac6-b9da-3e5646d820bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.428700 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9dbd-ee96-4ac6-b9da-3e5646d820bb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.428978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9dbd-ee96-4ac6-b9da-3e5646d820bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.429251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3f9dbd-ee96-4ac6-b9da-3e5646d820bb admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.430097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f9dbd-ee96-4ac6-b9da-3e5646d820bb admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:54.430408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f9dbd-ee96-4ac6-b9da-3e5646d820bb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.432294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3f9dbd-ee96-4ac6-b9da-3e5646d820bb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.452374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 321/645] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:54 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:54.460173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2220b-fd91-40a0-a9c9-6c05d2851542 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.477504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2220b-fd91-40a0-a9c9-6c05d2851542 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.482842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd69a7d-a358-4159-8b37-74319e7485af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.483480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69a7d-a358-4159-8b37-74319e7485af admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.483756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69a7d-a358-4159-8b37-74319e7485af admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.484023 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd69a7d-a358-4159-8b37-74319e7485af admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.493844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69a7d-a358-4159-8b37-74319e7485af admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=0a7c06728e9b49b68a4ea132f467c603) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:54.493844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69a7d-a358-4159-8b37-74319e7485af admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.493844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd69a7d-a358-4159-8b37-74319e7485af admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.493844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 325/646] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:54 2021] GET /identity/v3/role_assignments?user.id=0a7c06728e9b49b68a4ea132f467c603&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 259 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:54.676170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aea7c-f68d-4c36-8a96-cf9572d0ce72 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.676733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aea7c-f68d-4c36-8a96-cf9572d0ce72 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.676733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86aea7c-f68d-4c36-8a96-cf9572d0ce72 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.678881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 322/647] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:54.686189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b5a21-9e4b-4133-a0e1-ac680ff3fb8d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.686692 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b5a21-9e4b-4133-a0e1-ac680ff3fb8d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.686800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b5a21-9e4b-4133-a0e1-ac680ff3fb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.713268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ae6b5a21-9e4b-4133-a0e1-ac680ff3fb8d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:54.713268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ae6b5a21-9e4b-4133-a0e1-ac680ff3fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:54.722816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 326/648] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:54 2021] POST /identity/v3/auth/tokens => generated 1171 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:54.746381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aea7c-f68d-4c36-8a96-cf9572d0ce72 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:54.765634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86aea7c-f68d-4c36-8a96-cf9572d0ce72 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:54.770258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23eff0-5830-4274-bc98-01c7d967708b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:54.770912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23eff0-5830-4274-bc98-01c7d967708b admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:54.771187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23eff0-5830-4274-bc98-01c7d967708b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:54.771457 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23eff0-5830-4274-bc98-01c7d967708b admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:54.772183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23eff0-5830-4274-bc98-01c7d967708b admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:54.776171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23eff0-5830-4274-bc98-01c7d967708b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:54.873933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 323/649] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:00:54 2021] POST /identity/v3/services => generated 240 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:00:55.280803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057ffef-5598-405b-b8e4-9a7161db04a1 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.280991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057ffef-5598-405b-b8e4-9a7161db04a1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.281273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057ffef-5598-405b-b8e4-9a7161db04a1 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.283820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 327/650] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:55.290417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2da524-17c5-4908-81fe-9503c0807afe None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.290932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2da524-17c5-4908-81fe-9503c0807afe None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.291406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2da524-17c5-4908-81fe-9503c0807afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.309976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ec2da524-17c5-4908-81fe-9503c0807afe None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:55.311447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ec2da524-17c5-4908-81fe-9503c0807afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:55.334176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 324/651] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:55 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:55.360101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057ffef-5598-405b-b8e4-9a7161db04a1 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.375978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057ffef-5598-405b-b8e4-9a7161db04a1 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.381422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad4860-e210-4241-9fdd-260fcf48a4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.382470 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad4860-e210-4241-9fdd-260fcf48a4a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.382951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad4860-e210-4241-9fdd-260fcf48a4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.383419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ad4860-e210-4241-9fdd-260fcf48a4a7 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.395356 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ad4860-e210-4241-9fdd-260fcf48a4a7 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:55.402717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-c2ad4860-e210-4241-9fdd-260fcf48a4a7 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:55.404420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 328/652] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/roles/admin => generated 83 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:55.411679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2da524-17c5-4908-81fe-9503c0807afe None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.422929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2da524-17c5-4908-81fe-9503c0807afe None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.431617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131e0f-f05e-410d-96fb-04af2bc28140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.432283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131e0f-f05e-410d-96fb-04af2bc28140 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.432560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131e0f-f05e-410d-96fb-04af2bc28140 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.432828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92131e0f-f05e-410d-96fb-04af2bc28140 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.433585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131e0f-f05e-410d-96fb-04af2bc28140 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:55.433883 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131e0f-f05e-410d-96fb-04af2bc28140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.435494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92131e0f-f05e-410d-96fb-04af2bc28140 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.444582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 325/653] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:55.450676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad4860-e210-4241-9fdd-260fcf48a4a7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.464799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ad4860-e210-4241-9fdd-260fcf48a4a7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.469724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069ebf4-26bf-4c20-a13c-4e85575afe89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.471401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069ebf4-26bf-4c20-a13c-4e85575afe89 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.471828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069ebf4-26bf-4c20-a13c-4e85575afe89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.472243 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069ebf4-26bf-4c20-a13c-4e85575afe89 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.484709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069ebf4-26bf-4c20-a13c-4e85575afe89 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.487651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069ebf4-26bf-4c20-a13c-4e85575afe89 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.504955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-4069ebf4-26bf-4c20-a13c-4e85575afe89 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:55.506712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 329/654] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:55.513224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131e0f-f05e-410d-96fb-04af2bc28140 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.524050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92131e0f-f05e-410d-96fb-04af2bc28140 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.528838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50cb1-d6e8-46df-944e-ecc348eadb9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.529652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50cb1-d6e8-46df-944e-ecc348eadb9b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.530106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50cb1-d6e8-46df-944e-ecc348eadb9b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.530524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50cb1-d6e8-46df-944e-ecc348eadb9b admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.531442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50cb1-d6e8-46df-944e-ecc348eadb9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:55.531903 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50cb1-d6e8-46df-944e-ecc348eadb9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.534157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50cb1-d6e8-46df-944e-ecc348eadb9b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.547943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 326/655] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:55.554996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069ebf4-26bf-4c20-a13c-4e85575afe89 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.565409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069ebf4-26bf-4c20-a13c-4e85575afe89 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.570349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b615c-f6dc-48b9-bfa4-8fa545d7ab13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.571302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b615c-f6dc-48b9-bfa4-8fa545d7ab13 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.571727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b615c-f6dc-48b9-bfa4-8fa545d7ab13 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.572141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b615c-f6dc-48b9-bfa4-8fa545d7ab13 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.580806 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b615c-f6dc-48b9-bfa4-8fa545d7ab13 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.583025 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763b615c-f6dc-48b9-bfa4-8fa545d7ab13 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.597422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-763b615c-f6dc-48b9-bfa4-8fa545d7ab13 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:00:55.599146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 330/656] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/users/swift => generated 83 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:55.605565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50cb1-d6e8-46df-944e-ecc348eadb9b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.616239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50cb1-d6e8-46df-944e-ecc348eadb9b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.621306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18038daf-9cce-47dc-872e-79af196b5b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.622169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18038daf-9cce-47dc-872e-79af196b5b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.622591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18038daf-9cce-47dc-872e-79af196b5b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.623004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18038daf-9cce-47dc-872e-79af196b5b33 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.623982 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18038daf-9cce-47dc-872e-79af196b5b33 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:55.624446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18038daf-9cce-47dc-872e-79af196b5b33 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.626462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18038daf-9cce-47dc-872e-79af196b5b33 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.644553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 327/657] 10.222.0.32 () {56 vars in 1156 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:55.651110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b615c-f6dc-48b9-bfa4-8fa545d7ab13 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.667262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b615c-f6dc-48b9-bfa4-8fa545d7ab13 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.673401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf718e-fa26-471f-ba4d-57a9b1eaf485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.674777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf718e-fa26-471f-ba4d-57a9b1eaf485 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.675204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf718e-fa26-471f-ba4d-57a9b1eaf485 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.675619 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf718e-fa26-471f-ba4d-57a9b1eaf485 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.690096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf718e-fa26-471f-ba4d-57a9b1eaf485 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.692488 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf718e-fa26-471f-ba4d-57a9b1eaf485 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.707610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 331/658] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:00:55.718208 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18038daf-9cce-47dc-872e-79af196b5b33 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.731003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18038daf-9cce-47dc-872e-79af196b5b33 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.735757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298363ef-18f4-48fa-b5bc-ac56cfc226f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.737387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298363ef-18f4-48fa-b5bc-ac56cfc226f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.737813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298363ef-18f4-48fa-b5bc-ac56cfc226f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.738263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298363ef-18f4-48fa-b5bc-ac56cfc226f4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.749149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298363ef-18f4-48fa-b5bc-ac56cfc226f4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.751165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298363ef-18f4-48fa-b5bc-ac56cfc226f4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.769190 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-298363ef-18f4-48fa-b5bc-ac56cfc226f4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:55.770883 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 328/659] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:55.777352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf718e-fa26-471f-ba4d-57a9b1eaf485 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.787079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf718e-fa26-471f-ba4d-57a9b1eaf485 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.791767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e17b4-75cb-46e8-8407-ab6e036c20bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.792945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e17b4-75cb-46e8-8407-ab6e036c20bb admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.793368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e17b4-75cb-46e8-8407-ab6e036c20bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.793781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e17b4-75cb-46e8-8407-ab6e036c20bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.794682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e17b4-75cb-46e8-8407-ab6e036c20bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:55.795120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e17b4-75cb-46e8-8407-ab6e036c20bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.796822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e17b4-75cb-46e8-8407-ab6e036c20bb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.809726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 332/660] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:55.816948 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298363ef-18f4-48fa-b5bc-ac56cfc226f4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.827330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298363ef-18f4-48fa-b5bc-ac56cfc226f4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.833153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed9ea1-4f2d-4905-a15e-8909d39ba67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.834284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed9ea1-4f2d-4905-a15e-8909d39ba67f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.834704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed9ea1-4f2d-4905-a15e-8909d39ba67f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.835109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ed9ea1-4f2d-4905-a15e-8909d39ba67f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.844563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed9ea1-4f2d-4905-a15e-8909d39ba67f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.847478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ed9ea1-4f2d-4905-a15e-8909d39ba67f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.861272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-31ed9ea1-4f2d-4905-a15e-8909d39ba67f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:55.863150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 329/661] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:55.869642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e17b4-75cb-46e8-8407-ab6e036c20bb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.880825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e17b4-75cb-46e8-8407-ab6e036c20bb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.885433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a73edfd-1737-4c92-8ad3-dbaaded93f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.886298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73edfd-1737-4c92-8ad3-dbaaded93f9d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.886715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73edfd-1737-4c92-8ad3-dbaaded93f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.887122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a73edfd-1737-4c92-8ad3-dbaaded93f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.888046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73edfd-1737-4c92-8ad3-dbaaded93f9d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:55.888488 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73edfd-1737-4c92-8ad3-dbaaded93f9d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.890481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a73edfd-1737-4c92-8ad3-dbaaded93f9d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.911760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 333/662] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:55.918766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed9ea1-4f2d-4905-a15e-8909d39ba67f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:55.930221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ed9ea1-4f2d-4905-a15e-8909d39ba67f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:55.942857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1920737-4798-4200-b3eb-4947746a08b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:55.943715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920737-4798-4200-b3eb-4947746a08b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:55.944134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920737-4798-4200-b3eb-4947746a08b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:55.944543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1920737-4798-4200-b3eb-4947746a08b0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:55.945520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1920737-4798-4200-b3eb-4947746a08b0 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=0a888473e9774db39941b0610769505a, user.id=3856a21179234c9ebcbd4a9bd7ee3945) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:55.945979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1920737-4798-4200-b3eb-4947746a08b0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:55.947951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1920737-4798-4200-b3eb-4947746a08b0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:55.958172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 330/663] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:55 2021] GET /identity/v3/role_assignments?user.id=3856a21179234c9ebcbd4a9bd7ee3945&scope.project.id=0a888473e9774db39941b0610769505a&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 259 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:56.452468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b41f4-5201-4d2e-8910-68af88c5b43b None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.452755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b41f4-5201-4d2e-8910-68af88c5b43b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.453031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60b41f4-5201-4d2e-8910-68af88c5b43b None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.455436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 334/664] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:56.461525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085789ec-eff8-4ef4-8fe5-82cd85b1b900 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.461805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085789ec-eff8-4ef4-8fe5-82cd85b1b900 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.462099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085789ec-eff8-4ef4-8fe5-82cd85b1b900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.483868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-085789ec-eff8-4ef4-8fe5-82cd85b1b900 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:56.485046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-085789ec-eff8-4ef4-8fe5-82cd85b1b900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:56.497361 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 331/665] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:56 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:56.522782 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b41f4-5201-4d2e-8910-68af88c5b43b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:56.540908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60b41f4-5201-4d2e-8910-68af88c5b43b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:56.550358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f60f8-de04-430b-8856-9eae82ea2de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:56.551433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f60f8-de04-430b-8856-9eae82ea2de8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.551921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f60f8-de04-430b-8856-9eae82ea2de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.552396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f60f8-de04-430b-8856-9eae82ea2de8 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.570886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096f60f8-de04-430b-8856-9eae82ea2de8 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:56.577904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-096f60f8-de04-430b-8856-9eae82ea2de8 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:56.580126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 335/666] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:56 2021] GET /identity/v3/roles/admin => generated 83 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:56.586721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085789ec-eff8-4ef4-8fe5-82cd85b1b900 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:56.596414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085789ec-eff8-4ef4-8fe5-82cd85b1b900 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:56.602119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c1845-5947-4b15-99f3-b42e00c0383b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:56.603046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1845-5947-4b15-99f3-b42e00c0383b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.603531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1845-5947-4b15-99f3-b42e00c0383b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.604007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c1845-5947-4b15-99f3-b42e00c0383b admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.604975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c1845-5947-4b15-99f3-b42e00c0383b admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:56.605503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c1845-5947-4b15-99f3-b42e00c0383b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:56.607318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c1845-5947-4b15-99f3-b42e00c0383b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:56.621916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 332/667] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:56 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:56.628705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f60f8-de04-430b-8856-9eae82ea2de8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:56.639174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f60f8-de04-430b-8856-9eae82ea2de8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:56.644596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fb9a2-f810-460a-907a-1b25a01bd8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:56.645629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fb9a2-f810-460a-907a-1b25a01bd8cf admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.646144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fb9a2-f810-460a-907a-1b25a01bd8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.646619 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7fb9a2-f810-460a-907a-1b25a01bd8cf admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.657204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fb9a2-f810-460a-907a-1b25a01bd8cf admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:56.660185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7fb9a2-f810-460a-907a-1b25a01bd8cf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:56.676956 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-2a7fb9a2-f810-460a-907a-1b25a01bd8cf admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:56.678808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 336/668] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:56.685244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c1845-5947-4b15-99f3-b42e00c0383b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:56.695286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c1845-5947-4b15-99f3-b42e00c0383b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:56.700198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffc9f2-13bc-4fa6-8433-ef3edf81e112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:56.701156 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffc9f2-13bc-4fa6-8433-ef3edf81e112 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.701686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffc9f2-13bc-4fa6-8433-ef3edf81e112 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.702198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfffc9f2-13bc-4fa6-8433-ef3edf81e112 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.703187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffc9f2-13bc-4fa6-8433-ef3edf81e112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:56.703742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffc9f2-13bc-4fa6-8433-ef3edf81e112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:56.706149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfffc9f2-13bc-4fa6-8433-ef3edf81e112 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:56.718585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 333/669] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:56.725943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fb9a2-f810-460a-907a-1b25a01bd8cf admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:56.738132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7fb9a2-f810-460a-907a-1b25a01bd8cf admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:56.745375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0b22-c8d1-40f3-821a-c287f6c9d2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:56.746482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0b22-c8d1-40f3-821a-c287f6c9d2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.747018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0b22-c8d1-40f3-821a-c287f6c9d2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.747491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d0b22-c8d1-40f3-821a-c287f6c9d2b5 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.755337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d0b22-c8d1-40f3-821a-c287f6c9d2b5 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:56.757638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d0b22-c8d1-40f3-821a-c287f6c9d2b5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:56.772479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-5a3d0b22-c8d1-40f3-821a-c287f6c9d2b5 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:00:56.774207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 337/670] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Oct 27 01:00:56 2021] GET /identity/v3/users/nova => generated 82 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:56.780610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffc9f2-13bc-4fa6-8433-ef3edf81e112 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:56.791702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfffc9f2-13bc-4fa6-8433-ef3edf81e112 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:56.796608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68203f0-1c22-40ec-a8cb-671f2b656d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:56.797569 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68203f0-1c22-40ec-a8cb-671f2b656d1f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.798140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68203f0-1c22-40ec-a8cb-671f2b656d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.799403 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68203f0-1c22-40ec-a8cb-671f2b656d1f admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.800460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68203f0-1c22-40ec-a8cb-671f2b656d1f admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:56.801021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68203f0-1c22-40ec-a8cb-671f2b656d1f admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:56.803136 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68203f0-1c22-40ec-a8cb-671f2b656d1f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:56.826184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 334/671] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Oct 27 01:00:56 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:56.832836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0b22-c8d1-40f3-821a-c287f6c9d2b5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:56.843886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d0b22-c8d1-40f3-821a-c287f6c9d2b5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:56.849491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1588-14b8-4c7a-94dc-6ad5f91c2a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:56.850476 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1588-14b8-4c7a-94dc-6ad5f91c2a23 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.851052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1588-14b8-4c7a-94dc-6ad5f91c2a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.851528 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b1588-14b8-4c7a-94dc-6ad5f91c2a23 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.860537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b1588-14b8-4c7a-94dc-6ad5f91c2a23 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:56.863559 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b1588-14b8-4c7a-94dc-6ad5f91c2a23 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:56.877580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 338/672] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:00:56 2021] GET /identity/v3/auth/tokens => generated 1270 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:00:56.884221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68203f0-1c22-40ec-a8cb-671f2b656d1f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:56.899482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68203f0-1c22-40ec-a8cb-671f2b656d1f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:56.909316 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9144b-38a3-4640-85f6-bb86b5014d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:56.910510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9144b-38a3-4640-85f6-bb86b5014d76 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.911013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9144b-38a3-4640-85f6-bb86b5014d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.911508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e9144b-38a3-4640-85f6-bb86b5014d76 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.932147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9144b-38a3-4640-85f6-bb86b5014d76 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:56.934441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e9144b-38a3-4640-85f6-bb86b5014d76 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:56.955179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-23e9144b-38a3-4640-85f6-bb86b5014d76 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:56.956747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 335/673] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:56 2021] GET /identity/v3/domains/Default => generated 87 bytes in 73 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:56.963131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1588-14b8-4c7a-94dc-6ad5f91c2a23 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:56.972637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b1588-14b8-4c7a-94dc-6ad5f91c2a23 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:56.989428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae399475-2e66-4b24-af92-8c6fc35b8b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:56.989428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae399475-2e66-4b24-af92-8c6fc35b8b70 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:56.989428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae399475-2e66-4b24-af92-8c6fc35b8b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:56.989428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae399475-2e66-4b24-af92-8c6fc35b8b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:56.991749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae399475-2e66-4b24-af92-8c6fc35b8b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:56.992064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae399475-2e66-4b24-af92-8c6fc35b8b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:56.993639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae399475-2e66-4b24-af92-8c6fc35b8b70 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.009360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 339/674] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:57.015493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9144b-38a3-4640-85f6-bb86b5014d76 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.026285 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e9144b-38a3-4640-85f6-bb86b5014d76 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.031100 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c18f6-1e4d-488b-b1ca-3c40b4a3a1dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.032043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c18f6-1e4d-488b-b1ca-3c40b4a3a1dd admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.032481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c18f6-1e4d-488b-b1ca-3c40b4a3a1dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.032988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c18f6-1e4d-488b-b1ca-3c40b4a3a1dd admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.040737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c18f6-1e4d-488b-b1ca-3c40b4a3a1dd admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.042940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c18f6-1e4d-488b-b1ca-3c40b4a3a1dd admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.056618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-869c18f6-1e4d-488b-b1ca-3c40b4a3a1dd admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:57.062422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 336/675] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/projects/service => generated 88 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:57.066877 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae399475-2e66-4b24-af92-8c6fc35b8b70 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.076899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae399475-2e66-4b24-af92-8c6fc35b8b70 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.082546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b85c356-5389-4275-82e4-79923f505604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.083418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85c356-5389-4275-82e4-79923f505604 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.083841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85c356-5389-4275-82e4-79923f505604 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.084271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b85c356-5389-4275-82e4-79923f505604 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.085223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85c356-5389-4275-82e4-79923f505604 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:57.085690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85c356-5389-4275-82e4-79923f505604 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.087819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b85c356-5389-4275-82e4-79923f505604 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.101836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 340/676] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:57.108621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c18f6-1e4d-488b-b1ca-3c40b4a3a1dd admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.120488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c18f6-1e4d-488b-b1ca-3c40b4a3a1dd admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.130069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48076f7b-5c1e-447f-99c1-8c0a5465af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.130069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48076f7b-5c1e-447f-99c1-8c0a5465af62 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.130069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48076f7b-5c1e-447f-99c1-8c0a5465af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.130069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48076f7b-5c1e-447f-99c1-8c0a5465af62 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.130446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48076f7b-5c1e-447f-99c1-8c0a5465af62 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=0a888473e9774db39941b0610769505a, user.id=d1596a916d784f6bb6e3b876f4820903) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:57.130638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48076f7b-5c1e-447f-99c1-8c0a5465af62 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.132616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48076f7b-5c1e-447f-99c1-8c0a5465af62 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.140592 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 337/677] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/role_assignments?user.id=d1596a916d784f6bb6e3b876f4820903&scope.project.id=0a888473e9774db39941b0610769505a&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 608 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:57.315988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7c7e0-165e-4ffe-a10e-2a7132e8796a None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.316558 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7c7e0-165e-4ffe-a10e-2a7132e8796a None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.317001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7c7e0-165e-4ffe-a10e-2a7132e8796a None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.319293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 341/678] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:57.327390 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fc17e-736b-41c8-a938-4106c3dd630b None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.327827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fc17e-736b-41c8-a938-4106c3dd630b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.328205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fc17e-736b-41c8-a938-4106c3dd630b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.363462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d96fc17e-736b-41c8-a938-4106c3dd630b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:57.364834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d96fc17e-736b-41c8-a938-4106c3dd630b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:57.379976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 338/679] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:57.413112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7c7e0-165e-4ffe-a10e-2a7132e8796a None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.427111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7c7e0-165e-4ffe-a10e-2a7132e8796a None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.431622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cba0c-d176-42fe-87e0-b29c15c0f9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.432521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cba0c-d176-42fe-87e0-b29c15c0f9fa admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.432794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cba0c-d176-42fe-87e0-b29c15c0f9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.433060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cba0c-d176-42fe-87e0-b29c15c0f9fa admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.433759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cba0c-d176-42fe-87e0-b29c15c0f9fa admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.435510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032cba0c-d176-42fe-87e0-b29c15c0f9fa admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.448705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-032cba0c-d176-42fe-87e0-b29c15c0f9fa admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:00:57.450296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 342/680] 10.222.0.32 () {56 vars in 1150 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:57.457710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fc17e-736b-41c8-a938-4106c3dd630b None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.467170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fc17e-736b-41c8-a938-4106c3dd630b None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.472510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939ca2-5d30-429a-ad76-cf346a23a5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.473165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939ca2-5d30-429a-ad76-cf346a23a5cd admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.473436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939ca2-5d30-429a-ad76-cf346a23a5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.473704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9939ca2-5d30-429a-ad76-cf346a23a5cd admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.474461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939ca2-5d30-429a-ad76-cf346a23a5cd admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:57.474759 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939ca2-5d30-429a-ad76-cf346a23a5cd admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.476437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9939ca2-5d30-429a-ad76-cf346a23a5cd admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.481818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 339/681] 10.222.0.32 () {56 vars in 1145 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:57.488821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cba0c-d176-42fe-87e0-b29c15c0f9fa admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.498824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032cba0c-d176-42fe-87e0-b29c15c0f9fa admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.504516 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1badcb70-b704-432e-82dc-410ff11ecfb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.505229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badcb70-b704-432e-82dc-410ff11ecfb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.505504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badcb70-b704-432e-82dc-410ff11ecfb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.505776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1badcb70-b704-432e-82dc-410ff11ecfb1 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.506576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badcb70-b704-432e-82dc-410ff11ecfb1 admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:57.506875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badcb70-b704-432e-82dc-410ff11ecfb1 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.508545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1badcb70-b704-432e-82dc-410ff11ecfb1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.514397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 343/682] 10.222.0.32 () {56 vars in 1145 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:57.521315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939ca2-5d30-429a-ad76-cf346a23a5cd admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.531728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9939ca2-5d30-429a-ad76-cf346a23a5cd admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.536517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.537159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.537483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.538047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.539030 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] RBAC: Adding query filter params (interface=public, service_id=77c97748f438477c908843e3496c093c, region_id=RegionOne) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:57.539415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.540467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:57.540467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:00:57.540467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:00:57.541376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.550539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 340/683] 10.222.0.32 () {56 vars in 1272 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/endpoints?service_id=77c97748f438477c908843e3496c093c&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:57.553218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae7f2-f13b-4e31-92d1-3263cf1e8545 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.553506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae7f2-f13b-4e31-92d1-3263cf1e8545 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.553781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbae7f2-f13b-4e31-92d1-3263cf1e8545 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.556465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.557062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 344/684] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:57 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:57.562596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b32b18-93d7-4ebe-8ac5-b589805815b2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.562898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b32b18-93d7-4ebe-8ac5-b589805815b2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.563141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b32b18-93d7-4ebe-8ac5-b589805815b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.567806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1108ca53-94fa-4bea-8c31-474a740cc3bf admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.572332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79732e-3f3d-4d50-9460-4a6da6096922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.573007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79732e-3f3d-4d50-9460-4a6da6096922 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.573284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79732e-3f3d-4d50-9460-4a6da6096922 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.573554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79732e-3f3d-4d50-9460-4a6da6096922 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.574301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79732e-3f3d-4d50-9460-4a6da6096922 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.575939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79732e-3f3d-4d50-9460-4a6da6096922 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.582093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 341/685] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/services => generated 772 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:57.585365 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-89b32b18-93d7-4ebe-8ac5-b589805815b2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:57.586801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-89b32b18-93d7-4ebe-8ac5-b589805815b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:57.602203 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 345/686] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:57.621460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79732e-3f3d-4d50-9460-4a6da6096922 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.633016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79732e-3f3d-4d50-9460-4a6da6096922 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.638913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55442f36-1a11-49a4-8773-276c1d093e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.639777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55442f36-1a11-49a4-8773-276c1d093e49 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.640051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55442f36-1a11-49a4-8773-276c1d093e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.640320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55442f36-1a11-49a4-8773-276c1d093e49 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.653470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55442f36-1a11-49a4-8773-276c1d093e49 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:57.661233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-55442f36-1a11-49a4-8773-276c1d093e49 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:00:57.662854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 342/687] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:57.669335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b32b18-93d7-4ebe-8ac5-b589805815b2 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.680363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b32b18-93d7-4ebe-8ac5-b589805815b2 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.686757 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2721bd-9fc2-45ba-bec0-7b9a7f11fad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.687763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2721bd-9fc2-45ba-bec0-7b9a7f11fad0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.688262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2721bd-9fc2-45ba-bec0-7b9a7f11fad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.688721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2721bd-9fc2-45ba-bec0-7b9a7f11fad0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.689797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2721bd-9fc2-45ba-bec0-7b9a7f11fad0 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:57.690366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2721bd-9fc2-45ba-bec0-7b9a7f11fad0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.692232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2721bd-9fc2-45ba-bec0-7b9a7f11fad0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.707088 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 346/688] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:57.713579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55442f36-1a11-49a4-8773-276c1d093e49 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.725584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55442f36-1a11-49a4-8773-276c1d093e49 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.732155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd41f31-f58f-481f-b8db-5f1b0cae2e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.733337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd41f31-f58f-481f-b8db-5f1b0cae2e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.733802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd41f31-f58f-481f-b8db-5f1b0cae2e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.734338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd41f31-f58f-481f-b8db-5f1b0cae2e62 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.748268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd41f31-f58f-481f-b8db-5f1b0cae2e62 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.750599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd41f31-f58f-481f-b8db-5f1b0cae2e62 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.769859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-8dd41f31-f58f-481f-b8db-5f1b0cae2e62 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:57.771850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 343/689] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:57.778257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2721bd-9fc2-45ba-bec0-7b9a7f11fad0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.790777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2721bd-9fc2-45ba-bec0-7b9a7f11fad0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.796423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c389b7-349d-4a7f-8cfc-721cc37169f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.797415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c389b7-349d-4a7f-8cfc-721cc37169f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.797868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c389b7-349d-4a7f-8cfc-721cc37169f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.799019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c389b7-349d-4a7f-8cfc-721cc37169f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.800163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c389b7-349d-4a7f-8cfc-721cc37169f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:57.800644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c389b7-349d-4a7f-8cfc-721cc37169f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.802573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c389b7-349d-4a7f-8cfc-721cc37169f3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.821207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 347/690] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:57.827132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd41f31-f58f-481f-b8db-5f1b0cae2e62 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.838349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd41f31-f58f-481f-b8db-5f1b0cae2e62 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.846614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95705ab7-a845-49c5-9e46-a8c8fa2c16ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.847524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705ab7-a845-49c5-9e46-a8c8fa2c16ec admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.847878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705ab7-a845-49c5-9e46-a8c8fa2c16ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.848223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95705ab7-a845-49c5-9e46-a8c8fa2c16ec admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.856174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95705ab7-a845-49c5-9e46-a8c8fa2c16ec admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.858351 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95705ab7-a845-49c5-9e46-a8c8fa2c16ec admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.873111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42210-c4c6-4f43-b9a8-02e7ca1b40a3 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.873697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42210-c4c6-4f43-b9a8-02e7ca1b40a3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.874204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a42210-c4c6-4f43-b9a8-02e7ca1b40a3 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.875840 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-95705ab7-a845-49c5-9e46-a8c8fa2c16ec admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:00:57.877052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 348/691] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:00:57.881695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 344/692] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:57.884121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95705ab7-a845-49c5-9e46-a8c8fa2c16ec admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.884709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363da952-af73-4c51-afcf-87a49e27056c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.885185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363da952-af73-4c51-afcf-87a49e27056c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.885681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363da952-af73-4c51-afcf-87a49e27056c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.895002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95705ab7-a845-49c5-9e46-a8c8fa2c16ec admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.900347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa9594-9a49-41c2-8504-60f91f1d53c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.901239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa9594-9a49-41c2-8504-60f91f1d53c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.901363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa9594-9a49-41c2-8504-60f91f1d53c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.901532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa9594-9a49-41c2-8504-60f91f1d53c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.902409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa9594-9a49-41c2-8504-60f91f1d53c8 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:57.902715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa9594-9a49-41c2-8504-60f91f1d53c8 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.904530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aa9594-9a49-41c2-8504-60f91f1d53c8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.909234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-363da952-af73-4c51-afcf-87a49e27056c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:57.910737 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-363da952-af73-4c51-afcf-87a49e27056c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:57.924038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 345/693] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:57.924494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 349/694] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:57 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:00:57.931057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa9594-9a49-41c2-8504-60f91f1d53c8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.942121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa9594-9a49-41c2-8504-60f91f1d53c8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.947253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f740b9-ca87-4a7a-bf55-5ab32f174097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.948283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f740b9-ca87-4a7a-bf55-5ab32f174097 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.948733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f740b9-ca87-4a7a-bf55-5ab32f174097 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.949219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f740b9-ca87-4a7a-bf55-5ab32f174097 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.950737 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363da952-af73-4c51-afcf-87a49e27056c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:57.966501 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363da952-af73-4c51-afcf-87a49e27056c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:57.973155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f740b9-ca87-4a7a-bf55-5ab32f174097 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.975028 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f740b9-ca87-4a7a-bf55-5ab32f174097 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.975988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fe327-7733-4dff-899d-ff24dc86775e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:57.976766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe327-7733-4dff-899d-ff24dc86775e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:57.977035 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe327-7733-4dff-899d-ff24dc86775e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:57.977296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349fe327-7733-4dff-899d-ff24dc86775e admin admin] PATH_INFO: `/v3/services/network` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:57.977957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fe327-7733-4dff-899d-ff24dc86775e admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:57.979581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349fe327-7733-4dff-899d-ff24dc86775e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:57.996869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-349fe327-7733-4dff-899d-ff24dc86775e admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:00:57.998077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 350/695] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/services/network => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:58.007894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fe327-7733-4dff-899d-ff24dc86775e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:58.015465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-86f740b9-ca87-4a7a-bf55-5ab32f174097 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:58.016788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 346/696] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:57 2021] GET /identity/v3/domains/Default => generated 87 bytes in 86 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:58.024604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f740b9-ca87-4a7a-bf55-5ab32f174097 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:58.032505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349fe327-7733-4dff-899d-ff24dc86775e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:58.040905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f740b9-ca87-4a7a-bf55-5ab32f174097 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:58.042057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950f808-2038-4a47-93f0-7dbf8e6b71e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:58.042710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950f808-2038-4a47-93f0-7dbf8e6b71e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.042985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950f808-2038-4a47-93f0-7dbf8e6b71e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.043249 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950f808-2038-4a47-93f0-7dbf8e6b71e4 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.043963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950f808-2038-4a47-93f0-7dbf8e6b71e4 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:58.044282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950f808-2038-4a47-93f0-7dbf8e6b71e4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:58.045931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950f808-2038-4a47-93f0-7dbf8e6b71e4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:58.052465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81c4d3-bf99-412d-a6c5-34666c6bea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:58.053140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c4d3-bf99-412d-a6c5-34666c6bea00 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.053383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c4d3-bf99-412d-a6c5-34666c6bea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.053647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81c4d3-bf99-412d-a6c5-34666c6bea00 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.054396 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81c4d3-bf99-412d-a6c5-34666c6bea00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:58.054689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81c4d3-bf99-412d-a6c5-34666c6bea00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:58.056400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81c4d3-bf99-412d-a6c5-34666c6bea00 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:58.064652 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 351/697] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:00:58 2021] GET /identity/v3/services?name=network => generated 124 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:58.072631 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950f808-2038-4a47-93f0-7dbf8e6b71e4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:58.073931 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 347/698] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:58 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:58.083084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81c4d3-bf99-412d-a6c5-34666c6bea00 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:58.083579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950f808-2038-4a47-93f0-7dbf8e6b71e4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:58.094553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81c4d3-bf99-412d-a6c5-34666c6bea00 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:58.095820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6eac0-79eb-489e-94a6-7f59b138dde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:58.096552 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6eac0-79eb-489e-94a6-7f59b138dde7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.096893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6eac0-79eb-489e-94a6-7f59b138dde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.097807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6eac0-79eb-489e-94a6-7f59b138dde7 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.098997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6eac0-79eb-489e-94a6-7f59b138dde7 admin admin] RBAC: Adding query filter params (type=network) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:58.100099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6eac0-79eb-489e-94a6-7f59b138dde7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:58.102236 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6eac0-79eb-489e-94a6-7f59b138dde7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:58.105833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38637c35-89e3-4924-ba1f-b0ee4cff3b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:58.106701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38637c35-89e3-4924-ba1f-b0ee4cff3b84 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.107740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38637c35-89e3-4924-ba1f-b0ee4cff3b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.108878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38637c35-89e3-4924-ba1f-b0ee4cff3b84 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.113296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 352/699] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:00:58 2021] GET /identity/v3/services?type=network => generated 350 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:58.123469 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6eac0-79eb-489e-94a6-7f59b138dde7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:58.130861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38637c35-89e3-4924-ba1f-b0ee4cff3b84 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:58.132881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38637c35-89e3-4924-ba1f-b0ee4cff3b84 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:58.138493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6eac0-79eb-489e-94a6-7f59b138dde7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:58.151308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-38637c35-89e3-4924-ba1f-b0ee4cff3b84 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:58.155026 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:58.155748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.156092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.156430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.157300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] RBAC: Adding query filter params (interface=public, service_id=790ba06979774e1aa01c216693a14f4e, region_id=RegionOne) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:58.157712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:58.158802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:list_endpoints failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:00:58.158802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:00:58.158802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:00:58.159909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:58.161081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 348/700] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:58 2021] GET /identity/v3/projects/service => generated 88 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:58.167329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38637c35-89e3-4924-ba1f-b0ee4cff3b84 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:58.177730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 353/701] 10.222.0.32 () {56 vars in 1272 bytes} [Wed Oct 27 01:00:58 2021] GET /identity/v3/endpoints?service_id=790ba06979774e1aa01c216693a14f4e&interface=public®ion_id=RegionOne => generated 194 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:58.179813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38637c35-89e3-4924-ba1f-b0ee4cff3b84 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:58.185340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4a85c-e5ca-4ad2-9722-98dc63de2f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:58.190712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4a85c-e5ca-4ad2-9722-98dc63de2f22 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.190992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4a85c-e5ca-4ad2-9722-98dc63de2f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.191262 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd4a85c-e5ca-4ad2-9722-98dc63de2f22 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.192053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4a85c-e5ca-4ad2-9722-98dc63de2f22 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:58.192354 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4a85c-e5ca-4ad2-9722-98dc63de2f22 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:58.194217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd4a85c-e5ca-4ad2-9722-98dc63de2f22 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:58.206960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:58.214624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 349/702] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:58 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:58.222933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4a85c-e5ca-4ad2-9722-98dc63de2f22 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:58.224580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1253b8d7-5951-488a-887e-682410988fc7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:58.229100 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94caa29-1c88-4a55-84f2-45386b5366e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:58.229798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94caa29-1c88-4a55-84f2-45386b5366e5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.230135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94caa29-1c88-4a55-84f2-45386b5366e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.230410 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94caa29-1c88-4a55-84f2-45386b5366e5 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.231107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94caa29-1c88-4a55-84f2-45386b5366e5 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:58.232730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94caa29-1c88-4a55-84f2-45386b5366e5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:58.238669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 354/703] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:00:58 2021] GET /identity/v3/services => generated 772 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:58.239125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd4a85c-e5ca-4ad2-9722-98dc63de2f22 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:58.249989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e48fd-29c3-450d-8b56-6b77e3ef2d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:58.250944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e48fd-29c3-450d-8b56-6b77e3ef2d61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.251222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e48fd-29c3-450d-8b56-6b77e3ef2d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.251693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e48fd-29c3-450d-8b56-6b77e3ef2d61 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/0a7c06728e9b49b68a4ea132f467c603/roles/4784162e8bd0416c9bc4ef9e01acb1d9` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.277104 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e48fd-29c3-450d-8b56-6b77e3ef2d61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=0a7c06728e9b49b68a4ea132f467c603, role_id=4784162e8bd0416c9bc4ef9e01acb1d9)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:58.279750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e48fd-29c3-450d-8b56-6b77e3ef2d61 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:58.411192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 350/704] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:58 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/0a7c06728e9b49b68a4ea132f467c603/roles/4784162e8bd0416c9bc4ef9e01acb1d9 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:00:58.827328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b0a8-9523-49db-9c05-738a9a9e53bb None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.827885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b0a8-9523-49db-9c05-738a9a9e53bb None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.827885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a21b0a8-9523-49db-9c05-738a9a9e53bb None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.829831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 355/705] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:00:58 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:00:58.836436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad67e-42bc-4e36-8f89-d0931c731194 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.836921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad67e-42bc-4e36-8f89-d0931c731194 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.837057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ad67e-42bc-4e36-8f89-d0931c731194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.863138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e63ad67e-42bc-4e36-8f89-d0931c731194 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:00:58.864346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e63ad67e-42bc-4e36-8f89-d0931c731194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:00:58.932934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 351/706] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:00:58 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:00:58.957317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21b0a8-9523-49db-9c05-738a9a9e53bb None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:58.969767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a21b0a8-9523-49db-9c05-738a9a9e53bb None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:58.974990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70059d4-1b87-4318-a22a-54fde5403307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:58.975814 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70059d4-1b87-4318-a22a-54fde5403307 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:58.976139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70059d4-1b87-4318-a22a-54fde5403307 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:58.976412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70059d4-1b87-4318-a22a-54fde5403307 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:58.990056 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70059d4-1b87-4318-a22a-54fde5403307 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:00:58.994593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-c70059d4-1b87-4318-a22a-54fde5403307 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:00:58.997580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 356/707] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:58 2021] GET /identity/v3/roles/admin => generated 83 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:59.003178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ad67e-42bc-4e36-8f89-d0931c731194 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.012583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ad67e-42bc-4e36-8f89-d0931c731194 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.021470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b56c91-9fa0-49da-99d5-1e20f1fa3976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.022545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56c91-9fa0-49da-99d5-1e20f1fa3976 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.022975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56c91-9fa0-49da-99d5-1e20f1fa3976 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.023252 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b56c91-9fa0-49da-99d5-1e20f1fa3976 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.024082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b56c91-9fa0-49da-99d5-1e20f1fa3976 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:59.024384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b56c91-9fa0-49da-99d5-1e20f1fa3976 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.026074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b56c91-9fa0-49da-99d5-1e20f1fa3976 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.038988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 352/708] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:00:59 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:00:59.044999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70059d4-1b87-4318-a22a-54fde5403307 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.057978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70059d4-1b87-4318-a22a-54fde5403307 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.063684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d95773-d7f0-4652-9494-11ddced49ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.064785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d95773-d7f0-4652-9494-11ddced49ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.065161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d95773-d7f0-4652-9494-11ddced49ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.065533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d95773-d7f0-4652-9494-11ddced49ee7 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.079159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d95773-d7f0-4652-9494-11ddced49ee7 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.081763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d95773-d7f0-4652-9494-11ddced49ee7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.103510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-41d95773-d7f0-4652-9494-11ddced49ee7 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:59.105062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 357/709] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:00:59.111686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b56c91-9fa0-49da-99d5-1e20f1fa3976 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.122502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b56c91-9fa0-49da-99d5-1e20f1fa3976 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.131136 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fd9d5-d3a2-414d-8d23-3243dd2b4637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.131984 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd9d5-d3a2-414d-8d23-3243dd2b4637 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.132355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd9d5-d3a2-414d-8d23-3243dd2b4637 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.132770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923fd9d5-d3a2-414d-8d23-3243dd2b4637 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.133603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fd9d5-d3a2-414d-8d23-3243dd2b4637 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:59.134057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fd9d5-d3a2-414d-8d23-3243dd2b4637 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.135907 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923fd9d5-d3a2-414d-8d23-3243dd2b4637 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.153700 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 353/710] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:59.160576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d95773-d7f0-4652-9494-11ddced49ee7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.172224 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d95773-d7f0-4652-9494-11ddced49ee7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.178447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6273f22-9660-4960-b7de-e7b73706d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.179383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6273f22-9660-4960-b7de-e7b73706d235 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.179753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6273f22-9660-4960-b7de-e7b73706d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.180147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6273f22-9660-4960-b7de-e7b73706d235 admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.189942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6273f22-9660-4960-b7de-e7b73706d235 admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.192268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6273f22-9660-4960-b7de-e7b73706d235 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.209167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-b6273f22-9660-4960-b7de-e7b73706d235 admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:00:59.210834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 358/711] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:00:59 2021] GET /identity/v3/users/swift => generated 83 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:59.216756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fd9d5-d3a2-414d-8d23-3243dd2b4637 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.226852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923fd9d5-d3a2-414d-8d23-3243dd2b4637 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.233566 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efee89-2341-4bed-8f42-d5764798f6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.234370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efee89-2341-4bed-8f42-d5764798f6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.234794 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efee89-2341-4bed-8f42-d5764798f6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.235159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44efee89-2341-4bed-8f42-d5764798f6a0 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.236261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efee89-2341-4bed-8f42-d5764798f6a0 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:59.236677 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efee89-2341-4bed-8f42-d5764798f6a0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.238759 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44efee89-2341-4bed-8f42-d5764798f6a0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.260841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 354/712] 10.222.0.32 () {56 vars in 1156 bytes} [Wed Oct 27 01:00:59 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:59.266795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6273f22-9660-4960-b7de-e7b73706d235 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.283226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6273f22-9660-4960-b7de-e7b73706d235 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.288559 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73e62f-c4c6-42bc-ace3-a5e09d1ca3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.289492 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73e62f-c4c6-42bc-ace3-a5e09d1ca3e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.289868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73e62f-c4c6-42bc-ace3-a5e09d1ca3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.290256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a73e62f-c4c6-42bc-ace3-a5e09d1ca3e2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.302812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73e62f-c4c6-42bc-ace3-a5e09d1ca3e2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.304799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a73e62f-c4c6-42bc-ace3-a5e09d1ca3e2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.322164 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-8a73e62f-c4c6-42bc-ace3-a5e09d1ca3e2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:00:59.324062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 359/713] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:00:59 2021] GET /identity/v3/domains/Default => generated 87 bytes in 58 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:59.331543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efee89-2341-4bed-8f42-d5764798f6a0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.347735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44efee89-2341-4bed-8f42-d5764798f6a0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.358106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571edea-4ef0-4f50-93d6-766f90ecb348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.358877 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571edea-4ef0-4f50-93d6-766f90ecb348 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.359272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571edea-4ef0-4f50-93d6-766f90ecb348 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.359640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5571edea-4ef0-4f50-93d6-766f90ecb348 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.360474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571edea-4ef0-4f50-93d6-766f90ecb348 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:59.361089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571edea-4ef0-4f50-93d6-766f90ecb348 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.362887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5571edea-4ef0-4f50-93d6-766f90ecb348 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.383052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 355/714] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:00:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:59.388917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73e62f-c4c6-42bc-ace3-a5e09d1ca3e2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.402855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a73e62f-c4c6-42bc-ace3-a5e09d1ca3e2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.411056 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c86758-1e46-4eb0-bc36-766de5d2ee00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.412041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c86758-1e46-4eb0-bc36-766de5d2ee00 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.412482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c86758-1e46-4eb0-bc36-766de5d2ee00 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.412939 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c86758-1e46-4eb0-bc36-766de5d2ee00 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.427234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c86758-1e46-4eb0-bc36-766de5d2ee00 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.429174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c86758-1e46-4eb0-bc36-766de5d2ee00 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.447552 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-c6c86758-1e46-4eb0-bc36-766de5d2ee00 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:00:59.448775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 360/715] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:00:59 2021] GET /identity/v3/projects/service => generated 88 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:00:59.455602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571edea-4ef0-4f50-93d6-766f90ecb348 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.472381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5571edea-4ef0-4f50-93d6-766f90ecb348 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.486950 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a9f554-98f0-4b05-8695-a20adca6d780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.487615 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9f554-98f0-4b05-8695-a20adca6d780 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.487892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9f554-98f0-4b05-8695-a20adca6d780 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.488169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a9f554-98f0-4b05-8695-a20adca6d780 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.489027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9f554-98f0-4b05-8695-a20adca6d780 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:00:59.489334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9f554-98f0-4b05-8695-a20adca6d780 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.491186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a9f554-98f0-4b05-8695-a20adca6d780 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.507288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 356/716] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:00:59 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:00:59.513334 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c86758-1e46-4eb0-bc36-766de5d2ee00 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:00:59.528705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c86758-1e46-4eb0-bc36-766de5d2ee00 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:00:59.538206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01982681-affc-4746-9e28-edc340e0a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:00:59.539142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01982681-affc-4746-9e28-edc340e0a064 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:00:59.539487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01982681-affc-4746-9e28-edc340e0a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:00:59.539822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01982681-affc-4746-9e28-edc340e0a064 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/3856a21179234c9ebcbd4a9bd7ee3945/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:00:59.543382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01982681-affc-4746-9e28-edc340e0a064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=3856a21179234c9ebcbd4a9bd7ee3945, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:00:59.546058 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01982681-affc-4746-9e28-edc340e0a064 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:00:59.657061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 361/717] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:00:59 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/3856a21179234c9ebcbd4a9bd7ee3945/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:01:00.263859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89d325-e275-4d2c-909a-291bf21b1d78 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.264846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89d325-e275-4d2c-909a-291bf21b1d78 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.265340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e89d325-e275-4d2c-909a-291bf21b1d78 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.268725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 357/718] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:00 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:00.275311 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5302f-154a-451a-b57f-bb2d2a7218c5 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.276119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5302f-154a-451a-b57f-bb2d2a7218c5 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.276585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5302f-154a-451a-b57f-bb2d2a7218c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.282514 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78108a69-9511-4ad2-b0e8-8ecdd6f01a63 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.283447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78108a69-9511-4ad2-b0e8-8ecdd6f01a63 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.284297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78108a69-9511-4ad2-b0e8-8ecdd6f01a63 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.288661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 358/719] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:00 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:00.295024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb452f4-597c-486d-b841-d27bc9c2b6d4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.295519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb452f4-597c-486d-b841-d27bc9c2b6d4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.295984 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb452f4-597c-486d-b841-d27bc9c2b6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.307924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-14a5302f-154a-451a-b57f-bb2d2a7218c5 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:00.310125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-14a5302f-154a-451a-b57f-bb2d2a7218c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:00.326383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-deb452f4-597c-486d-b841-d27bc9c2b6d4 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:00.327981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-deb452f4-597c-486d-b841-d27bc9c2b6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:00.403700 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 359/720] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:00 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:00.415105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 362/721] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:00 2021] POST /identity/v3/auth/tokens => generated 1270 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:00.432956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb452f4-597c-486d-b841-d27bc9c2b6d4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:00.442428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb452f4-597c-486d-b841-d27bc9c2b6d4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:00.446920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:00.447715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.447984 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.448261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] PATH_INFO: `/v3/services/block-storage` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.448926 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:00.449932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:01:00.449932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:01:00.449932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:01:00.450871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:00.454218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5302f-154a-451a-b57f-bb2d2a7218c5 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:00.463668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5302f-154a-451a-b57f-bb2d2a7218c5 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:00.477467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 27 01:01:00.480608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36199c17-c25d-4136-b037-8287e2b135ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:00.481409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36199c17-c25d-4136-b037-8287e2b135ee admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.481684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36199c17-c25d-4136-b037-8287e2b135ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.481971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36199c17-c25d-4136-b037-8287e2b135ee admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.482694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36199c17-c25d-4136-b037-8287e2b135ee admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:00.484307 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36199c17-c25d-4136-b037-8287e2b135ee admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:00.489486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 360/722] 10.222.0.32 () {56 vars in 1150 bytes} [Wed Oct 27 01:01:00 2021] GET /identity/v3/services/block-storage => generated 94 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:00.502165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-36199c17-c25d-4136-b037-8287e2b135ee admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:01:00.503646 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 363/723] 10.222.0.32 () {56 vars in 1153 bytes} [Wed Oct 27 01:01:00 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:00.506391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:00.513475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36199c17-c25d-4136-b037-8287e2b135ee admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:00.518490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bc6a5-4ace-4360-ae18-30a70fb1142c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:00.530875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36199c17-c25d-4136-b037-8287e2b135ee admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:00.532045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec99f8-fd0f-4d2c-bf45-29cc9f012040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:00.533326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec99f8-fd0f-4d2c-bf45-29cc9f012040 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.533645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec99f8-fd0f-4d2c-bf45-29cc9f012040 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.533980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec99f8-fd0f-4d2c-bf45-29cc9f012040 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.534724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec99f8-fd0f-4d2c-bf45-29cc9f012040 admin admin] RBAC: Adding query filter params (name=block-storage) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:00.535027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec99f8-fd0f-4d2c-bf45-29cc9f012040 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:00.536626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec99f8-fd0f-4d2c-bf45-29cc9f012040 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:00.543274 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 361/724] 10.222.0.32 () {56 vars in 1145 bytes} [Wed Oct 27 01:01:00 2021] GET /identity/v3/services?name=block-storage => generated 130 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:00.549380 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5183bc-2d12-4bee-b2f1-df485d88555c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:00.550138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5183bc-2d12-4bee-b2f1-df485d88555c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.550424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5183bc-2d12-4bee-b2f1-df485d88555c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.550695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5183bc-2d12-4bee-b2f1-df485d88555c admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.551475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5183bc-2d12-4bee-b2f1-df485d88555c admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:00.551785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5183bc-2d12-4bee-b2f1-df485d88555c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:00.553345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5183bc-2d12-4bee-b2f1-df485d88555c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:00.558748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 364/725] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:00 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:00.561734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec99f8-fd0f-4d2c-bf45-29cc9f012040 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:00.568415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5183bc-2d12-4bee-b2f1-df485d88555c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:00.577524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec99f8-fd0f-4d2c-bf45-29cc9f012040 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:00.582860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5183bc-2d12-4bee-b2f1-df485d88555c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:00.583062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f167c-1973-4805-b28d-c0048dca440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:00.583659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f167c-1973-4805-b28d-c0048dca440b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.583941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f167c-1973-4805-b28d-c0048dca440b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.584213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f167c-1973-4805-b28d-c0048dca440b admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.584930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f167c-1973-4805-b28d-c0048dca440b admin admin] RBAC: Adding query filter params (type=block-storage) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:00.585230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f167c-1973-4805-b28d-c0048dca440b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:00.586957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f167c-1973-4805-b28d-c0048dca440b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:00.592651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b7eb0-b618-4347-9266-ade0fe019696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:00.593303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7eb0-b618-4347-9266-ade0fe019696 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.593577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7eb0-b618-4347-9266-ade0fe019696 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.593845 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b7eb0-b618-4347-9266-ade0fe019696 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.594589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b7eb0-b618-4347-9266-ade0fe019696 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:00.594890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b7eb0-b618-4347-9266-ade0fe019696 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:00.596849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b7eb0-b618-4347-9266-ade0fe019696 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:00.600435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 362/726] 10.222.0.32 () {56 vars in 1145 bytes} [Wed Oct 27 01:01:00 2021] GET /identity/v3/services?type=block-storage => generated 367 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:00.608269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f167c-1973-4805-b28d-c0048dca440b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:00.611194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 365/727] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:00 2021] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:00.632690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f167c-1973-4805-b28d-c0048dca440b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:00.655635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e9be79-8c5c-4db4-bc2f-e0faf72a526d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:00.656344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9be79-8c5c-4db4-bc2f-e0faf72a526d admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:00.656589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9be79-8c5c-4db4-bc2f-e0faf72a526d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:00.656861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e9be79-8c5c-4db4-bc2f-e0faf72a526d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:00.658233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9be79-8c5c-4db4-bc2f-e0faf72a526d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:00.659611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-f7e9be79-8c5c-4db4-bc2f-e0faf72a526d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:01:00.659611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:01:00.659611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:01:00.660478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e9be79-8c5c-4db4-bc2f-e0faf72a526d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:00.757777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 363/728] 10.222.0.32 () {60 vars in 1165 bytes} [Wed Oct 27 01:01:00 2021] POST /identity/v3/endpoints => generated 346 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:01:01.150966 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870157-69a2-4d9a-bcb0-df0381b44f29 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.151805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870157-69a2-4d9a-bcb0-df0381b44f29 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.152282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab870157-69a2-4d9a-bcb0-df0381b44f29 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.154510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 366/729] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:01.160791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52988551-f39a-4af2-8704-7178dc75b647 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.161079 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52988551-f39a-4af2-8704-7178dc75b647 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.161352 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52988551-f39a-4af2-8704-7178dc75b647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.181342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-52988551-f39a-4af2-8704-7178dc75b647 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:01.182578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-52988551-f39a-4af2-8704-7178dc75b647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:01.200631 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 364/730] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:01 2021] POST /identity/v3/auth/tokens => generated 1456 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:01.225676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab870157-69a2-4d9a-bcb0-df0381b44f29 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.241301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab870157-69a2-4d9a-bcb0-df0381b44f29 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.246068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b56c5a-ea3e-4b29-b5be-603ab605ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.247067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b56c5a-ea3e-4b29-b5be-603ab605ed8b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.247560 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b56c5a-ea3e-4b29-b5be-603ab605ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.248032 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b56c5a-ea3e-4b29-b5be-603ab605ed8b admin admin] PATH_INFO: `/v3/services/network` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.248894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b56c5a-ea3e-4b29-b5be-603ab605ed8b admin admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:01.250708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b56c5a-ea3e-4b29-b5be-603ab605ed8b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:01.264064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-58b56c5a-ea3e-4b29-b5be-603ab605ed8b admin admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 27 01:01:01.265851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 367/731] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/services/network => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:01.273373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52988551-f39a-4af2-8704-7178dc75b647 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.285261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52988551-f39a-4af2-8704-7178dc75b647 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.295233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127f2f-2116-4c55-b350-30e934e35898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.295891 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127f2f-2116-4c55-b350-30e934e35898 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.296170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127f2f-2116-4c55-b350-30e934e35898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.296439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c127f2f-2116-4c55-b350-30e934e35898 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.297159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c127f2f-2116-4c55-b350-30e934e35898 admin admin] RBAC: Adding query filter params (name=network) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:01.297456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c127f2f-2116-4c55-b350-30e934e35898 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:01.299828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c127f2f-2116-4c55-b350-30e934e35898 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:01.310366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 365/732] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/services?name=network => generated 124 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:01.317324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b56c5a-ea3e-4b29-b5be-603ab605ed8b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.331616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b56c5a-ea3e-4b29-b5be-603ab605ed8b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.338761 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60e904-903b-4345-946a-ef92162b74cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.339824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60e904-903b-4345-946a-ef92162b74cc admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.340316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60e904-903b-4345-946a-ef92162b74cc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.340777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60e904-903b-4345-946a-ef92162b74cc admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.341723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60e904-903b-4345-946a-ef92162b74cc admin admin] RBAC: Adding query filter params (type=network) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:01.342251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60e904-903b-4345-946a-ef92162b74cc admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:01.344054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d60e904-903b-4345-946a-ef92162b74cc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:01.350509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 368/733] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/services?type=network => generated 350 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:01.356888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127f2f-2116-4c55-b350-30e934e35898 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.371270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c127f2f-2116-4c55-b350-30e934e35898 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.380974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd16da9-b9e4-46e3-8e46-14f46503e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.381619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd16da9-b9e4-46e3-8e46-14f46503e4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.381899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd16da9-b9e4-46e3-8e46-14f46503e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.382196 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd16da9-b9e4-46e3-8e46-14f46503e4a4 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.382943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd16da9-b9e4-46e3-8e46-14f46503e4a4 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:01.384525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd16da9-b9e4-46e3-8e46-14f46503e4a4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:01.525983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 366/734] 10.222.0.32 () {60 vars in 1165 bytes} [Wed Oct 27 01:01:01 2021] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:01:01.609163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8b1dc-272a-4bc8-b9fa-f0c0ffa9a8ee None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.609492 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8b1dc-272a-4bc8-b9fa-f0c0ffa9a8ee None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.609716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8b1dc-272a-4bc8-b9fa-f0c0ffa9a8ee None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.612958 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 369/735] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:01 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:01.619431 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09dbb-1697-46de-8469-a81ff6694440 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.619710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09dbb-1697-46de-8469-a81ff6694440 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.619981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b09dbb-1697-46de-8469-a81ff6694440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.647547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-82b09dbb-1697-46de-8469-a81ff6694440 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:01.648782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-82b09dbb-1697-46de-8469-a81ff6694440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:01.667930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 367/736] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:01 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:01.694325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8b1dc-272a-4bc8-b9fa-f0c0ffa9a8ee None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.707948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8b1dc-272a-4bc8-b9fa-f0c0ffa9a8ee None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.712435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48f90b-143d-4010-a211-771906b7fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.713275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48f90b-143d-4010-a211-771906b7fc88 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.713575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48f90b-143d-4010-a211-771906b7fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.713817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be48f90b-143d-4010-a211-771906b7fc88 admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.726596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be48f90b-143d-4010-a211-771906b7fc88 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:01.733758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-be48f90b-143d-4010-a211-771906b7fc88 admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:01:01.738043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 370/737] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/roles/service => generated 85 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:01.743754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09dbb-1697-46de-8469-a81ff6694440 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.757220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b09dbb-1697-46de-8469-a81ff6694440 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.765855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff928e65-b95d-44e4-8491-c7434cbcb848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.767583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff928e65-b95d-44e4-8491-c7434cbcb848 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.768166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff928e65-b95d-44e4-8491-c7434cbcb848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.768634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff928e65-b95d-44e4-8491-c7434cbcb848 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.769687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff928e65-b95d-44e4-8491-c7434cbcb848 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:01.770249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff928e65-b95d-44e4-8491-c7434cbcb848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:01.772297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff928e65-b95d-44e4-8491-c7434cbcb848 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:01.788033 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 368/738] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:01.794018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48f90b-143d-4010-a211-771906b7fc88 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.808172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be48f90b-143d-4010-a211-771906b7fc88 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.815229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fab34-db6a-4c70-9575-7ca084c7b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.816018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fab34-db6a-4c70-9575-7ca084c7b37f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.816299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fab34-db6a-4c70-9575-7ca084c7b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.816573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fab34-db6a-4c70-9575-7ca084c7b37f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.827735 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fab34-db6a-4c70-9575-7ca084c7b37f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:01.829595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fab34-db6a-4c70-9575-7ca084c7b37f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:01.846780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-090fab34-db6a-4c70-9575-7ca084c7b37f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:01.853205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 371/739] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/domains/Default => generated 87 bytes in 55 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:01.854618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff928e65-b95d-44e4-8491-c7434cbcb848 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.865318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff928e65-b95d-44e4-8491-c7434cbcb848 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.869909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be22248-1f3a-4526-9444-b7706915acd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.870607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be22248-1f3a-4526-9444-b7706915acd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.870889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be22248-1f3a-4526-9444-b7706915acd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.871169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be22248-1f3a-4526-9444-b7706915acd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.871893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be22248-1f3a-4526-9444-b7706915acd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:01.872197 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be22248-1f3a-4526-9444-b7706915acd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:01.873801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be22248-1f3a-4526-9444-b7706915acd7 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:01.892387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 369/740] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:01.895143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fab34-db6a-4c70-9575-7ca084c7b37f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.905325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fab34-db6a-4c70-9575-7ca084c7b37f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.911586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15059-3690-41fb-87ee-6a26b62e34d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.912368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15059-3690-41fb-87ee-6a26b62e34d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.912670 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15059-3690-41fb-87ee-6a26b62e34d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.912925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15059-3690-41fb-87ee-6a26b62e34d2 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.921607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b15059-3690-41fb-87ee-6a26b62e34d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:01.924801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b15059-3690-41fb-87ee-6a26b62e34d2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:01.940400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e4b15059-3690-41fb-87ee-6a26b62e34d2 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:01:01.941820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 372/741] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:01.948200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be22248-1f3a-4526-9444-b7706915acd7 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:01.958308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be22248-1f3a-4526-9444-b7706915acd7 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:01.962925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec96c1-69b8-436f-9627-d0d591989fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:01.963559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec96c1-69b8-436f-9627-d0d591989fd0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:01.963838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec96c1-69b8-436f-9627-d0d591989fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:01.964108 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec96c1-69b8-436f-9627-d0d591989fd0 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:01.964987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec96c1-69b8-436f-9627-d0d591989fd0 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:01.965288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec96c1-69b8-436f-9627-d0d591989fd0 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:01.967130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebec96c1-69b8-436f-9627-d0d591989fd0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:01.988483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 370/742] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:01.994665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15059-3690-41fb-87ee-6a26b62e34d2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.005808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15059-3690-41fb-87ee-6a26b62e34d2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.011040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a95ef-f343-4046-9edc-cd93d2cfcf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.011686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a95ef-f343-4046-9edc-cd93d2cfcf2b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.011963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a95ef-f343-4046-9edc-cd93d2cfcf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.012235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553a95ef-f343-4046-9edc-cd93d2cfcf2b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.023388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a95ef-f343-4046-9edc-cd93d2cfcf2b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.025166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553a95ef-f343-4046-9edc-cd93d2cfcf2b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.040409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 373/743] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:01 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:02.043746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec96c1-69b8-436f-9627-d0d591989fd0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.059261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec96c1-69b8-436f-9627-d0d591989fd0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.064328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d428a-716d-42e4-8686-4411852e818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.065115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d428a-716d-42e4-8686-4411852e818f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.065385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d428a-716d-42e4-8686-4411852e818f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.065655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641d428a-716d-42e4-8686-4411852e818f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.076257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d428a-716d-42e4-8686-4411852e818f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.078102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641d428a-716d-42e4-8686-4411852e818f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.095548 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-641d428a-716d-42e4-8686-4411852e818f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:02.097166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 371/744] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 54 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:02.103176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a95ef-f343-4046-9edc-cd93d2cfcf2b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.113062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553a95ef-f343-4046-9edc-cd93d2cfcf2b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.117659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46813e5c-b8ba-48e5-bfee-43e7075597ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.118343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46813e5c-b8ba-48e5-bfee-43e7075597ed admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.118622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46813e5c-b8ba-48e5-bfee-43e7075597ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.118892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46813e5c-b8ba-48e5-bfee-43e7075597ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.119621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46813e5c-b8ba-48e5-bfee-43e7075597ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:02.119920 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46813e5c-b8ba-48e5-bfee-43e7075597ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.121479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46813e5c-b8ba-48e5-bfee-43e7075597ed admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.140183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 374/745] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:02.141508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d428a-716d-42e4-8686-4411852e818f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.155682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641d428a-716d-42e4-8686-4411852e818f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.160819 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4122de-440b-4b95-8c15-050b02429d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.161616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4122de-440b-4b95-8c15-050b02429d73 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.161937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4122de-440b-4b95-8c15-050b02429d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.162244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4122de-440b-4b95-8c15-050b02429d73 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.170417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4122de-440b-4b95-8c15-050b02429d73 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.172449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4122de-440b-4b95-8c15-050b02429d73 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.187261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-3e4122de-440b-4b95-8c15-050b02429d73 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:01:02.188776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 372/746] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:02.195298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46813e5c-b8ba-48e5-bfee-43e7075597ed admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.206017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46813e5c-b8ba-48e5-bfee-43e7075597ed admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.210404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03ae19-6915-41b8-9eb4-135001c3cba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.211058 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03ae19-6915-41b8-9eb4-135001c3cba6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.211340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03ae19-6915-41b8-9eb4-135001c3cba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.211617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03ae19-6915-41b8-9eb4-135001c3cba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.212419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03ae19-6915-41b8-9eb4-135001c3cba6 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:02.212726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03ae19-6915-41b8-9eb4-135001c3cba6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.214622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03ae19-6915-41b8-9eb4-135001c3cba6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.232955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 375/747] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:02.234707 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4122de-440b-4b95-8c15-050b02429d73 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.246195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4122de-440b-4b95-8c15-050b02429d73 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.250668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a47fc5-8a81-4c8d-8b15-73209d2ea233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.251338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47fc5-8a81-4c8d-8b15-73209d2ea233 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.251792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47fc5-8a81-4c8d-8b15-73209d2ea233 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.252291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a47fc5-8a81-4c8d-8b15-73209d2ea233 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.253145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47fc5-8a81-4c8d-8b15-73209d2ea233 admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=0a7c06728e9b49b68a4ea132f467c603) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:02.253455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47fc5-8a81-4c8d-8b15-73209d2ea233 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.255337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a47fc5-8a81-4c8d-8b15-73209d2ea233 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.266157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 373/748] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/role_assignments?user.id=0a7c06728e9b49b68a4ea132f467c603&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 608 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:02.437093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614155e-864c-4ca1-880a-16db06030397 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.437773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614155e-864c-4ca1-880a-16db06030397 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.437773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614155e-864c-4ca1-880a-16db06030397 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.440057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 376/749] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:02 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:02.446697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041e14e-beaa-4ff6-bad0-e04ab5c646b6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.447626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041e14e-beaa-4ff6-bad0-e04ab5c646b6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.448125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d041e14e-beaa-4ff6-bad0-e04ab5c646b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.467488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d041e14e-beaa-4ff6-bad0-e04ab5c646b6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:02.468999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d041e14e-beaa-4ff6-bad0-e04ab5c646b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:02.478964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 374/750] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:02 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:02.505290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614155e-864c-4ca1-880a-16db06030397 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.518639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614155e-864c-4ca1-880a-16db06030397 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.523616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438bc76-452b-4398-9c2f-a7df17ff6c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.524622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438bc76-452b-4398-9c2f-a7df17ff6c3c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.525155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438bc76-452b-4398-9c2f-a7df17ff6c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.531486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e438bc76-452b-4398-9c2f-a7df17ff6c3c admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.537496 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e438bc76-452b-4398-9c2f-a7df17ff6c3c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:02.545028 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e438bc76-452b-4398-9c2f-a7df17ff6c3c admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:01:02.546754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 377/751] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:02.553755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041e14e-beaa-4ff6-bad0-e04ab5c646b6 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.565815 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d041e14e-beaa-4ff6-bad0-e04ab5c646b6 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.571257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691165ac-69d4-4200-b4e3-c2883312e1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.571916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691165ac-69d4-4200-b4e3-c2883312e1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.572188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691165ac-69d4-4200-b4e3-c2883312e1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.572453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691165ac-69d4-4200-b4e3-c2883312e1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.573205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691165ac-69d4-4200-b4e3-c2883312e1a3 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:02.573504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691165ac-69d4-4200-b4e3-c2883312e1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.575202 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691165ac-69d4-4200-b4e3-c2883312e1a3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.585042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 375/752] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:02.593446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438bc76-452b-4398-9c2f-a7df17ff6c3c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.604987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e438bc76-452b-4398-9c2f-a7df17ff6c3c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.609817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6c43-39db-4547-9ec8-c761162321bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.610744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6c43-39db-4547-9ec8-c761162321bc admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.611012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6c43-39db-4547-9ec8-c761162321bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.611427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6c43-39db-4547-9ec8-c761162321bc admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.622186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab6c43-39db-4547-9ec8-c761162321bc admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.624058 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ab6c43-39db-4547-9ec8-c761162321bc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.641572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-a9ab6c43-39db-4547-9ec8-c761162321bc admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:02.643594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 378/753] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:02.649968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691165ac-69d4-4200-b4e3-c2883312e1a3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.664140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691165ac-69d4-4200-b4e3-c2883312e1a3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.668942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8796c-9f45-4c0b-9e86-c5f2e700c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.669798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8796c-9f45-4c0b-9e86-c5f2e700c249 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.670309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8796c-9f45-4c0b-9e86-c5f2e700c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.670750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8796c-9f45-4c0b-9e86-c5f2e700c249 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.671715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8796c-9f45-4c0b-9e86-c5f2e700c249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:02.672198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8796c-9f45-4c0b-9e86-c5f2e700c249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.674089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8796c-9f45-4c0b-9e86-c5f2e700c249 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.686591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 376/754] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:02.694589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6c43-39db-4547-9ec8-c761162321bc admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.705791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6c43-39db-4547-9ec8-c761162321bc admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.710742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137df6d-601d-4392-ab85-6d22ec4aa6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.711752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137df6d-601d-4392-ab85-6d22ec4aa6cf admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.712253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137df6d-601d-4392-ab85-6d22ec4aa6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.712694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9137df6d-601d-4392-ab85-6d22ec4aa6cf admin admin] PATH_INFO: `/v3/users/swift` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.721391 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137df6d-601d-4392-ab85-6d22ec4aa6cf admin admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.723737 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9137df6d-601d-4392-ab85-6d22ec4aa6cf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.738752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-9137df6d-601d-4392-ab85-6d22ec4aa6cf admin admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 27 01:01:02.740658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 379/755] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/users/swift => generated 83 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:02.747078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8796c-9f45-4c0b-9e86-c5f2e700c249 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.757393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8796c-9f45-4c0b-9e86-c5f2e700c249 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.762296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ca6ac-9fa4-4953-a7a9-ebeb827a64d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.763193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ca6ac-9fa4-4953-a7a9-ebeb827a64d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.763691 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ca6ac-9fa4-4953-a7a9-ebeb827a64d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.764133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0ca6ac-9fa4-4953-a7a9-ebeb827a64d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.765211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ca6ac-9fa4-4953-a7a9-ebeb827a64d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:02.765686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ca6ac-9fa4-4953-a7a9-ebeb827a64d4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.768356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0ca6ac-9fa4-4953-a7a9-ebeb827a64d4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.787748 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 377/756] 10.222.0.32 () {56 vars in 1156 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:02.794637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137df6d-601d-4392-ab85-6d22ec4aa6cf admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.806013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9137df6d-601d-4392-ab85-6d22ec4aa6cf admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.810945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95b6c-78e1-4667-9b3a-1d2a1ced7838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.811816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95b6c-78e1-4667-9b3a-1d2a1ced7838 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.812348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95b6c-78e1-4667-9b3a-1d2a1ced7838 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.812788 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a95b6c-78e1-4667-9b3a-1d2a1ced7838 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.822008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a95b6c-78e1-4667-9b3a-1d2a1ced7838 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.824060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a95b6c-78e1-4667-9b3a-1d2a1ced7838 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.833491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 380/757] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/auth/tokens => generated 1605 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:02.840525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ca6ac-9fa4-4953-a7a9-ebeb827a64d4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.850571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0ca6ac-9fa4-4953-a7a9-ebeb827a64d4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.855333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26195fe-4381-496c-9dfd-4de72f596352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.856355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26195fe-4381-496c-9dfd-4de72f596352 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.856871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26195fe-4381-496c-9dfd-4de72f596352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.857316 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26195fe-4381-496c-9dfd-4de72f596352 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.868448 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26195fe-4381-496c-9dfd-4de72f596352 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.870617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26195fe-4381-496c-9dfd-4de72f596352 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.888438 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-c26195fe-4381-496c-9dfd-4de72f596352 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:02.890238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 378/758] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/domains/Default => generated 87 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:02.898509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95b6c-78e1-4667-9b3a-1d2a1ced7838 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.908367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a95b6c-78e1-4667-9b3a-1d2a1ced7838 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.913207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8d7d-0754-4c22-9ddd-a231eceeb2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.914137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8d7d-0754-4c22-9ddd-a231eceeb2ca admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.914628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8d7d-0754-4c22-9ddd-a231eceeb2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.915068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f8d7d-0754-4c22-9ddd-a231eceeb2ca admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.916011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f8d7d-0754-4c22-9ddd-a231eceeb2ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:02.916499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f8d7d-0754-4c22-9ddd-a231eceeb2ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.918279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f8d7d-0754-4c22-9ddd-a231eceeb2ca admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.931437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 381/759] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:02.937777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26195fe-4381-496c-9dfd-4de72f596352 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:02.948477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26195fe-4381-496c-9dfd-4de72f596352 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:02.953211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a35f6-c365-40de-97a2-8c76d3d97c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:02.954293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a35f6-c365-40de-97a2-8c76d3d97c38 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:02.954760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a35f6-c365-40de-97a2-8c76d3d97c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:02.955195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5a35f6-c365-40de-97a2-8c76d3d97c38 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:02.962412 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a35f6-c365-40de-97a2-8c76d3d97c38 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:02.964549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5a35f6-c365-40de-97a2-8c76d3d97c38 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:02.978189 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-9d5a35f6-c365-40de-97a2-8c76d3d97c38 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:01:02.979877 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 379/760] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/projects/service => generated 88 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:02.990007 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8d7d-0754-4c22-9ddd-a231eceeb2ca admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:03.008322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f8d7d-0754-4c22-9ddd-a231eceeb2ca admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:03.013054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54d679-92fe-4c25-b4da-6d93272b3805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:03.013940 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54d679-92fe-4c25-b4da-6d93272b3805 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.014447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54d679-92fe-4c25-b4da-6d93272b3805 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.014931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54d679-92fe-4c25-b4da-6d93272b3805 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.015935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54d679-92fe-4c25-b4da-6d93272b3805 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:03.016423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54d679-92fe-4c25-b4da-6d93272b3805 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:03.018747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54d679-92fe-4c25-b4da-6d93272b3805 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:03.032310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 382/761] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:01:02 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:03.039885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a35f6-c365-40de-97a2-8c76d3d97c38 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:03.051930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5a35f6-c365-40de-97a2-8c76d3d97c38 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:03.056742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35234c63-bf6b-42cc-809b-7db73b6631be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:03.057584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234c63-bf6b-42cc-809b-7db73b6631be admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.058062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234c63-bf6b-42cc-809b-7db73b6631be admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.058556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35234c63-bf6b-42cc-809b-7db73b6631be admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.059623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35234c63-bf6b-42cc-809b-7db73b6631be admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=0a888473e9774db39941b0610769505a, user.id=3856a21179234c9ebcbd4a9bd7ee3945) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:03.060150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35234c63-bf6b-42cc-809b-7db73b6631be admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:03.062332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35234c63-bf6b-42cc-809b-7db73b6631be admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:03.069175 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 380/762] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:03 2021] GET /identity/v3/role_assignments?user.id=3856a21179234c9ebcbd4a9bd7ee3945&scope.project.id=0a888473e9774db39941b0610769505a&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 608 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:03.343239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c2a5-ea88-4456-8d98-a97bd3f33b95 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.344113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c2a5-ea88-4456-8d98-a97bd3f33b95 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.344613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9c2a5-ea88-4456-8d98-a97bd3f33b95 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.347432 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 383/763] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:03 2021] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:03.354597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432218e-59bc-407f-8210-afd4d686e911 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.354926 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432218e-59bc-407f-8210-afd4d686e911 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.355148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432218e-59bc-407f-8210-afd4d686e911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.375366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-1432218e-59bc-407f-8210-afd4d686e911 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:03.377383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1432218e-59bc-407f-8210-afd4d686e911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:03.390169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 381/764] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:03 2021] POST /identity/v3/auth/tokens => generated 1605 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:03.411122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c2a5-ea88-4456-8d98-a97bd3f33b95 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:03.428778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9c2a5-ea88-4456-8d98-a97bd3f33b95 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:03.433413 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cebc97-af14-4cbe-b2b7-1b1d6952de6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:03.434375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cebc97-af14-4cbe-b2b7-1b1d6952de6f admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.434852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cebc97-af14-4cbe-b2b7-1b1d6952de6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.435312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cebc97-af14-4cbe-b2b7-1b1d6952de6f admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.436238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cebc97-af14-4cbe-b2b7-1b1d6952de6f admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:03.437455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-f4cebc97-af14-4cbe-b2b7-1b1d6952de6f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_service failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:01:03.437455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:01:03.437455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:01:03.439880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cebc97-af14-4cbe-b2b7-1b1d6952de6f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:03.503368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420b604-465e-4bb8-8e46-07f8e4b035d1 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.503937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420b604-465e-4bb8-8e46-07f8e4b035d1 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.503937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7420b604-465e-4bb8-8e46-07f8e4b035d1 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.505812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 382/765] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:01:03.511231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e572-f4e3-4dbe-a27f-fcc873b8155f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.511512 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e572-f4e3-4dbe-a27f-fcc873b8155f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.511956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3e572-f4e3-4dbe-a27f-fcc873b8155f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.530127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 384/766] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:01:03 2021] POST /identity/v3/services => generated 269 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:03.538730 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-66a3e572-f4e3-4dbe-a27f-fcc873b8155f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:03.539941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-66a3e572-f4e3-4dbe-a27f-fcc873b8155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:03.560093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 383/767] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:03 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:03.585394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cebc97-af14-4cbe-b2b7-1b1d6952de6f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:03.597029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cebc97-af14-4cbe-b2b7-1b1d6952de6f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:03.601928 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eb9ff-e34f-4982-aee0-8585beedcf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:03.606546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eb9ff-e34f-4982-aee0-8585beedcf0d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.606546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eb9ff-e34f-4982-aee0-8585beedcf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.606546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93eb9ff-e34f-4982-aee0-8585beedcf0d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.606546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eb9ff-e34f-4982-aee0-8585beedcf0d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:03.606546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93eb9ff-e34f-4982-aee0-8585beedcf0d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:03.619944 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-f93eb9ff-e34f-4982-aee0-8585beedcf0d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:01:03.621795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 385/768] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:01:03 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:03.629420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3e572-f4e3-4dbe-a27f-fcc873b8155f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:03.639357 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3e572-f4e3-4dbe-a27f-fcc873b8155f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:03.644451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1662220e-cb54-4359-aa59-fa672cd7cc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:03.645369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662220e-cb54-4359-aa59-fa672cd7cc5a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.645846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662220e-cb54-4359-aa59-fa672cd7cc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.646307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1662220e-cb54-4359-aa59-fa672cd7cc5a admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.647482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662220e-cb54-4359-aa59-fa672cd7cc5a admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:03.647932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662220e-cb54-4359-aa59-fa672cd7cc5a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:03.649725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1662220e-cb54-4359-aa59-fa672cd7cc5a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:03.655601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 384/769] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:01:03 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:03.662741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eb9ff-e34f-4982-aee0-8585beedcf0d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:03.673957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93eb9ff-e34f-4982-aee0-8585beedcf0d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:03.679304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da7a58-c279-48f6-aed5-bc7f769503de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:03.680293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da7a58-c279-48f6-aed5-bc7f769503de admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:03.680732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da7a58-c279-48f6-aed5-bc7f769503de admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:03.681206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da7a58-c279-48f6-aed5-bc7f769503de admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:03.682106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da7a58-c279-48f6-aed5-bc7f769503de admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:03.682629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da7a58-c279-48f6-aed5-bc7f769503de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:03.684411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da7a58-c279-48f6-aed5-bc7f769503de admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:03.690408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 386/770] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:01:03 2021] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:04.710193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb9d76-0aef-46c9-9afe-a6b573e7e1c2 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:04.710736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb9d76-0aef-46c9-9afe-a6b573e7e1c2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:04.710736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb9d76-0aef-46c9-9afe-a6b573e7e1c2 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:04.712737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 385/771] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:04.718791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca6d85-399f-4beb-863e-4296f13daac6 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:04.719244 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca6d85-399f-4beb-863e-4296f13daac6 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:04.719325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eca6d85-399f-4beb-863e-4296f13daac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:04.738309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8eca6d85-399f-4beb-863e-4296f13daac6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:04.739494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8eca6d85-399f-4beb-863e-4296f13daac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:04.747428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 387/772] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:04 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:04.772890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb9d76-0aef-46c9-9afe-a6b573e7e1c2 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:04.785732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb9d76-0aef-46c9-9afe-a6b573e7e1c2 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:04.790121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0d33b-93fb-42e4-b746-596c42f8e682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:04.790900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0d33b-93fb-42e4-b746-596c42f8e682 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:04.791174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0d33b-93fb-42e4-b746-596c42f8e682 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:04.791439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf0d33b-93fb-42e4-b746-596c42f8e682 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:04.802769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf0d33b-93fb-42e4-b746-596c42f8e682 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:04.810128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-3bf0d33b-93fb-42e4-b746-596c42f8e682 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:01:04.811623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 386/773] 10.222.0.32 () {56 vars in 1141 bytes} [Wed Oct 27 01:01:04 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:04.818891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca6d85-399f-4beb-863e-4296f13daac6 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:04.828241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eca6d85-399f-4beb-863e-4296f13daac6 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:04.833261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679791ad-2447-4915-a7bc-7cdfe9b4a11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:04.833935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679791ad-2447-4915-a7bc-7cdfe9b4a11f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:04.834240 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679791ad-2447-4915-a7bc-7cdfe9b4a11f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:04.834511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679791ad-2447-4915-a7bc-7cdfe9b4a11f admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:04.835280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679791ad-2447-4915-a7bc-7cdfe9b4a11f admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:04.835578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679791ad-2447-4915-a7bc-7cdfe9b4a11f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:04.837156 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679791ad-2447-4915-a7bc-7cdfe9b4a11f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:04.846167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 388/774] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Oct 27 01:01:04 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:04.852350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0d33b-93fb-42e4-b746-596c42f8e682 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:04.862595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf0d33b-93fb-42e4-b746-596c42f8e682 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:04.867229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176edbc-e8e5-465a-8045-51e6ab0bd85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:04.868003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176edbc-e8e5-465a-8045-51e6ab0bd85c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:04.868278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176edbc-e8e5-465a-8045-51e6ab0bd85c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:04.868546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176edbc-e8e5-465a-8045-51e6ab0bd85c admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:04.881507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176edbc-e8e5-465a-8045-51e6ab0bd85c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:04.883488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6176edbc-e8e5-465a-8045-51e6ab0bd85c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:04.902842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-6176edbc-e8e5-465a-8045-51e6ab0bd85c admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:04.904482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 387/775] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:04 2021] GET /identity/v3/domains/Default => generated 87 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:04.910675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679791ad-2447-4915-a7bc-7cdfe9b4a11f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:04.920357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679791ad-2447-4915-a7bc-7cdfe9b4a11f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:04.925699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d7392-08d2-4ef7-aa63-b67f598442c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:04.926378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d7392-08d2-4ef7-aa63-b67f598442c1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:04.926653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d7392-08d2-4ef7-aa63-b67f598442c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:04.926924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65d7392-08d2-4ef7-aa63-b67f598442c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:04.927654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d7392-08d2-4ef7-aa63-b67f598442c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:04.927953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d7392-08d2-4ef7-aa63-b67f598442c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:04.929669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65d7392-08d2-4ef7-aa63-b67f598442c1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:04.942738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 389/776] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:04.949049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176edbc-e8e5-465a-8045-51e6ab0bd85c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:04.959046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176edbc-e8e5-465a-8045-51e6ab0bd85c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:04.963666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3069e71-ce62-4ba3-8816-ceb9dcc0b8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:04.964400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3069e71-ce62-4ba3-8816-ceb9dcc0b8eb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:04.964675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3069e71-ce62-4ba3-8816-ceb9dcc0b8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:04.964946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3069e71-ce62-4ba3-8816-ceb9dcc0b8eb admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:04.973746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3069e71-ce62-4ba3-8816-ceb9dcc0b8eb admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:04.975771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3069e71-ce62-4ba3-8816-ceb9dcc0b8eb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:04.991129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-b3069e71-ce62-4ba3-8816-ceb9dcc0b8eb admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:01:04.992655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 388/777] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:01:04 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:04.998956 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d7392-08d2-4ef7-aa63-b67f598442c1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.009805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65d7392-08d2-4ef7-aa63-b67f598442c1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.014511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dea668-a21d-442d-b90f-f5c55d4e1cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.015171 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dea668-a21d-442d-b90f-f5c55d4e1cfb admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.015443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dea668-a21d-442d-b90f-f5c55d4e1cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.015715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dea668-a21d-442d-b90f-f5c55d4e1cfb admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.016587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dea668-a21d-442d-b90f-f5c55d4e1cfb admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:05.016908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dea668-a21d-442d-b90f-f5c55d4e1cfb admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.018933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dea668-a21d-442d-b90f-f5c55d4e1cfb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.037225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 390/778] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Oct 27 01:01:04 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:05.043531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3069e71-ce62-4ba3-8816-ceb9dcc0b8eb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.054387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3069e71-ce62-4ba3-8816-ceb9dcc0b8eb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.059015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcad7b-6066-479f-ac75-9ccf60f3bfb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.059650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcad7b-6066-479f-ac75-9ccf60f3bfb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.059935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcad7b-6066-479f-ac75-9ccf60f3bfb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.060249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbcad7b-6066-479f-ac75-9ccf60f3bfb5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.069130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcad7b-6066-479f-ac75-9ccf60f3bfb5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.070961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbcad7b-6066-479f-ac75-9ccf60f3bfb5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.080572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 389/779] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:05 2021] GET /identity/v3/auth/tokens => generated 1715 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:05.087076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dea668-a21d-442d-b90f-f5c55d4e1cfb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.097005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dea668-a21d-442d-b90f-f5c55d4e1cfb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.101748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad75b09-bb94-4820-97c1-b38d4cbcb660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.102658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad75b09-bb94-4820-97c1-b38d4cbcb660 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.102935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad75b09-bb94-4820-97c1-b38d4cbcb660 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.103252 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad75b09-bb94-4820-97c1-b38d4cbcb660 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.114863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad75b09-bb94-4820-97c1-b38d4cbcb660 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.116726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad75b09-bb94-4820-97c1-b38d4cbcb660 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.134136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-dad75b09-bb94-4820-97c1-b38d4cbcb660 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:05.135742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 391/780] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:05 2021] GET /identity/v3/domains/Default => generated 87 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:05.141458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcad7b-6066-479f-ac75-9ccf60f3bfb5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.150824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbcad7b-6066-479f-ac75-9ccf60f3bfb5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.155666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa24958-67a4-4a24-9282-e5f367219d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.156366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24958-67a4-4a24-9282-e5f367219d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.156645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24958-67a4-4a24-9282-e5f367219d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.156916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa24958-67a4-4a24-9282-e5f367219d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.158330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa24958-67a4-4a24-9282-e5f367219d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:05.158647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa24958-67a4-4a24-9282-e5f367219d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.160240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa24958-67a4-4a24-9282-e5f367219d71 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.172319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 390/781] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:05 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:05.179005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad75b09-bb94-4820-97c1-b38d4cbcb660 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.191214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad75b09-bb94-4820-97c1-b38d4cbcb660 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.196362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9846f05-b7df-45d5-a395-49590eaf6298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.197392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9846f05-b7df-45d5-a395-49590eaf6298 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.197870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9846f05-b7df-45d5-a395-49590eaf6298 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.198339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9846f05-b7df-45d5-a395-49590eaf6298 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.205674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9846f05-b7df-45d5-a395-49590eaf6298 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.207875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9846f05-b7df-45d5-a395-49590eaf6298 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.221874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-f9846f05-b7df-45d5-a395-49590eaf6298 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:01:05.223532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 392/782] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:05 2021] GET /identity/v3/projects/service => generated 88 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:05.230015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa24958-67a4-4a24-9282-e5f367219d71 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.240724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa24958-67a4-4a24-9282-e5f367219d71 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.245665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4530bf27-950f-4bf5-a904-b3bcbd5db664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.246543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530bf27-950f-4bf5-a904-b3bcbd5db664 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.247043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530bf27-950f-4bf5-a904-b3bcbd5db664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.247501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4530bf27-950f-4bf5-a904-b3bcbd5db664 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.248581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530bf27-950f-4bf5-a904-b3bcbd5db664 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:05.249057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530bf27-950f-4bf5-a904-b3bcbd5db664 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.251215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4530bf27-950f-4bf5-a904-b3bcbd5db664 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.263840 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 391/783] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:01:05 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:05.270860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9846f05-b7df-45d5-a395-49590eaf6298 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.281541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9846f05-b7df-45d5-a395-49590eaf6298 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.286994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b264f-43ff-44db-aef0-ee056b92b0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.287848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b264f-43ff-44db-aef0-ee056b92b0a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.288318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b264f-43ff-44db-aef0-ee056b92b0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.288774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b264f-43ff-44db-aef0-ee056b92b0a6 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.289776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b264f-43ff-44db-aef0-ee056b92b0a6 admin admin] RBAC: Adding query filter params (role.id=f0e32f91782a4af6b2f454c61b696692, scope.project.id=0a888473e9774db39941b0610769505a, user.id=0a7c06728e9b49b68a4ea132f467c603) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:05.290295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b264f-43ff-44db-aef0-ee056b92b0a6 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.292270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2b264f-43ff-44db-aef0-ee056b92b0a6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.298743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 393/784] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:05 2021] GET /identity/v3/role_assignments?user.id=0a7c06728e9b49b68a4ea132f467c603&scope.project.id=0a888473e9774db39941b0610769505a&role.id=f0e32f91782a4af6b2f454c61b696692 => generated 259 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:05.511018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ad427-9141-4fb8-8149-2c6b0db75759 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.511355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ad427-9141-4fb8-8149-2c6b0db75759 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.511531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ad427-9141-4fb8-8149-2c6b0db75759 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.513468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 392/785] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:05.520973 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030effa-376a-4391-9120-62aa78ed0b97 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.521259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030effa-376a-4391-9120-62aa78ed0b97 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.521530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030effa-376a-4391-9120-62aa78ed0b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.540466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f030effa-376a-4391-9120-62aa78ed0b97 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:05.541635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f030effa-376a-4391-9120-62aa78ed0b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:05.550302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 394/786] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:05 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:05.574802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ad427-9141-4fb8-8149-2c6b0db75759 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.588074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ad427-9141-4fb8-8149-2c6b0db75759 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.592815 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd547e75-ee43-43d7-bc99-6c67fee19d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.593816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd547e75-ee43-43d7-bc99-6c67fee19d5b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.594322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd547e75-ee43-43d7-bc99-6c67fee19d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.594821 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd547e75-ee43-43d7-bc99-6c67fee19d5b admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.596107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd547e75-ee43-43d7-bc99-6c67fee19d5b admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.597886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd547e75-ee43-43d7-bc99-6c67fee19d5b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.609903 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-dd547e75-ee43-43d7-bc99-6c67fee19d5b admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:01:05.617900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 393/787] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:05 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:05.619441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030effa-376a-4391-9120-62aa78ed0b97 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.629814 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030effa-376a-4391-9120-62aa78ed0b97 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.634608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b0c9c-397e-43e3-8f82-ef452255e79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.635487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b0c9c-397e-43e3-8f82-ef452255e79e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.635978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b0c9c-397e-43e3-8f82-ef452255e79e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.636431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b0c9c-397e-43e3-8f82-ef452255e79e admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.637396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b0c9c-397e-43e3-8f82-ef452255e79e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:05.637882 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b0c9c-397e-43e3-8f82-ef452255e79e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.639826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b0c9c-397e-43e3-8f82-ef452255e79e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.650251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 395/788] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:05 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:05.653019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd547e75-ee43-43d7-bc99-6c67fee19d5b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:05.663844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd547e75-ee43-43d7-bc99-6c67fee19d5b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:05.668578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a2cfe3-5f94-4dfc-af7c-d1882ceecf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:05.669427 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2cfe3-5f94-4dfc-af7c-d1882ceecf98 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.669919 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2cfe3-5f94-4dfc-af7c-d1882ceecf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.670389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a2cfe3-5f94-4dfc-af7c-d1882ceecf98 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.671278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2cfe3-5f94-4dfc-af7c-d1882ceecf98 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:05.671758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2cfe3-5f94-4dfc-af7c-d1882ceecf98 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:05.674578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a2cfe3-5f94-4dfc-af7c-d1882ceecf98 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:05.686051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 394/789] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:05 2021] GET /identity/v3/services?type=object-store => generated 129 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:05.978970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9251c-ec37-4198-a484-ea24b0f1dd16 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.979512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9251c-ec37-4198-a484-ea24b0f1dd16 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.979512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9251c-ec37-4198-a484-ea24b0f1dd16 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:05.981515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 396/790] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:05.993422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820006c0-f847-4a3c-a348-5ba3a98c4e77 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:05.993913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820006c0-f847-4a3c-a348-5ba3a98c4e77 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:05.993999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820006c0-f847-4a3c-a348-5ba3a98c4e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:06.014221 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf823ec-0585-4513-8eed-b4c72670c33e None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:06.014501 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf823ec-0585-4513-8eed-b4c72670c33e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:06.014779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf823ec-0585-4513-8eed-b4c72670c33e None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:06.016931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 397/791] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:01:06.017977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-820006c0-f847-4a3c-a348-5ba3a98c4e77 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:06.019258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-820006c0-f847-4a3c-a348-5ba3a98c4e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:06.023347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bafef0-91fd-4531-88cb-fa7a2565742b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:06.023695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bafef0-91fd-4531-88cb-fa7a2565742b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:06.024203 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bafef0-91fd-4531-88cb-fa7a2565742b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:06.031822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 395/792] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:05 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:06.043134 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-16bafef0-91fd-4531-88cb-fa7a2565742b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:06.044625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-16bafef0-91fd-4531-88cb-fa7a2565742b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:06.052896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820006c0-f847-4a3c-a348-5ba3a98c4e77 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:06.054255 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 398/793] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:06 2021] POST /identity/v3/auth/tokens => generated 1715 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:06.061958 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820006c0-f847-4a3c-a348-5ba3a98c4e77 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:06.066572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6773378-b1ec-4b02-9aea-9694f026bd73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:06.067370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6773378-b1ec-4b02-9aea-9694f026bd73 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:06.067644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6773378-b1ec-4b02-9aea-9694f026bd73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:06.067910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6773378-b1ec-4b02-9aea-9694f026bd73 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:06.068567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6773378-b1ec-4b02-9aea-9694f026bd73 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:06.070170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6773378-b1ec-4b02-9aea-9694f026bd73 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:06.080663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bafef0-91fd-4531-88cb-fa7a2565742b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:06.081560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-e6773378-b1ec-4b02-9aea-9694f026bd73 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:01:06.083003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 396/794] 10.222.0.32 () {56 vars in 1153 bytes} [Wed Oct 27 01:01:06 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 30 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:06.089231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6773378-b1ec-4b02-9aea-9694f026bd73 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:06.091321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bafef0-91fd-4531-88cb-fa7a2565742b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:06.096896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a9a41b-13ce-4d83-b8d0-83ae2b32d6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:06.097858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9a41b-13ce-4d83-b8d0-83ae2b32d6d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:06.098373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9a41b-13ce-4d83-b8d0-83ae2b32d6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:06.098899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a9a41b-13ce-4d83-b8d0-83ae2b32d6d4 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:06.099282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6773378-b1ec-4b02-9aea-9694f026bd73 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:06.100043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9a41b-13ce-4d83-b8d0-83ae2b32d6d4 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:06.102017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a9a41b-13ce-4d83-b8d0-83ae2b32d6d4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:06.103702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a47bf-e5f0-41d9-b72e-55be6a83006e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:06.104333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a47bf-e5f0-41d9-b72e-55be6a83006e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:06.104609 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a47bf-e5f0-41d9-b72e-55be6a83006e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:06.104878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a47bf-e5f0-41d9-b72e-55be6a83006e admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:06.105577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a47bf-e5f0-41d9-b72e-55be6a83006e admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:06.105875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a47bf-e5f0-41d9-b72e-55be6a83006e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:06.107455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a47bf-e5f0-41d9-b72e-55be6a83006e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:06.112804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 397/795] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:06 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:06.118760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a47bf-e5f0-41d9-b72e-55be6a83006e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:06.129471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a47bf-e5f0-41d9-b72e-55be6a83006e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:06.134371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f753fba-47b6-4f50-906b-9f52c3474775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:06.135056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f753fba-47b6-4f50-906b-9f52c3474775 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:06.135342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f753fba-47b6-4f50-906b-9f52c3474775 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:06.135617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f753fba-47b6-4f50-906b-9f52c3474775 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:06.136455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f753fba-47b6-4f50-906b-9f52c3474775 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:06.136758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f753fba-47b6-4f50-906b-9f52c3474775 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:06.138456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f753fba-47b6-4f50-906b-9f52c3474775 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:06.149495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 398/796] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:06 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:06.150602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f753fba-47b6-4f50-906b-9f52c3474775 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:06.161426 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f753fba-47b6-4f50-906b-9f52c3474775 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:06.165980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad9d3-e322-45c2-8d40-4b8efe3209c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:06.166728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad9d3-e322-45c2-8d40-4b8efe3209c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:06.167056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad9d3-e322-45c2-8d40-4b8efe3209c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:06.167334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ad9d3-e322-45c2-8d40-4b8efe3209c2 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:06.168217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ad9d3-e322-45c2-8d40-4b8efe3209c2 admin admin] RBAC: Adding query filter params (interface=public, service_id=04b05990715d4a6f9bcc118cff5eca84, region_id=RegionOne) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:06.168530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ad9d3-e322-45c2-8d40-4b8efe3209c2 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:06.170203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ad9d3-e322-45c2-8d40-4b8efe3209c2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:06.177516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 399/797] 10.222.0.32 () {56 vars in 1272 bytes} [Wed Oct 27 01:01:06 2021] GET /identity/v3/endpoints?service_id=04b05990715d4a6f9bcc118cff5eca84&interface=public®ion_id=RegionOne => generated 194 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:06.182407 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad9d3-e322-45c2-8d40-4b8efe3209c2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:06.189199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 399/798] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:01:06 2021] POST /identity/v3/services => generated 251 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:06.193459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ad9d3-e322-45c2-8d40-4b8efe3209c2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:06.210113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb94efc-0dcb-41b1-9e4e-f1d1aae58936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:06.211157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94efc-0dcb-41b1-9e4e-f1d1aae58936 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:06.211675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94efc-0dcb-41b1-9e4e-f1d1aae58936 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:06.212140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb94efc-0dcb-41b1-9e4e-f1d1aae58936 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:06.213067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94efc-0dcb-41b1-9e4e-f1d1aae58936 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:06.214934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb94efc-0dcb-41b1-9e4e-f1d1aae58936 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:06.222689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 400/799] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:01:06 2021] GET /identity/v3/services => generated 1268 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:01:07.616360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9b52-d0fc-4187-b5ef-03494590c9ce None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:07.616905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9b52-d0fc-4187-b5ef-03494590c9ce None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:07.616905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e9b52-d0fc-4187-b5ef-03494590c9ce None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:07.618922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 400/800] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:07.625204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240a19b-6cf4-4b63-a347-6d378d03f339 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:07.625673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240a19b-6cf4-4b63-a347-6d378d03f339 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:07.625752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240a19b-6cf4-4b63-a347-6d378d03f339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:07.643439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4240a19b-6cf4-4b63-a347-6d378d03f339 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:07.644619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4240a19b-6cf4-4b63-a347-6d378d03f339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:07.652837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 401/801] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:07 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:07.677355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e9b52-d0fc-4187-b5ef-03494590c9ce None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:07.689592 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e9b52-d0fc-4187-b5ef-03494590c9ce None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:07.693933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0fa61-330a-4056-9b7d-8b009a8e9419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:07.694751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0fa61-330a-4056-9b7d-8b009a8e9419 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:07.695025 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0fa61-330a-4056-9b7d-8b009a8e9419 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:07.695292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc0fa61-330a-4056-9b7d-8b009a8e9419 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:07.705462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc0fa61-330a-4056-9b7d-8b009a8e9419 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:07.712719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-9dc0fa61-330a-4056-9b7d-8b009a8e9419 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:01:07.714188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 401/802] 10.222.0.32 () {56 vars in 1141 bytes} [Wed Oct 27 01:01:07 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:07.721243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240a19b-6cf4-4b63-a347-6d378d03f339 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:07.730152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240a19b-6cf4-4b63-a347-6d378d03f339 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:07.734620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98beaa-c911-4c11-90fb-865b79719b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:07.735886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98beaa-c911-4c11-90fb-865b79719b6a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:07.736282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98beaa-c911-4c11-90fb-865b79719b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:07.736557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c98beaa-c911-4c11-90fb-865b79719b6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:07.737310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98beaa-c911-4c11-90fb-865b79719b6a admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:07.737611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98beaa-c911-4c11-90fb-865b79719b6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:07.739219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c98beaa-c911-4c11-90fb-865b79719b6a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:07.747534 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 402/803] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Oct 27 01:01:07 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:07.753794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0fa61-330a-4056-9b7d-8b009a8e9419 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:07.764052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc0fa61-330a-4056-9b7d-8b009a8e9419 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:07.769108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301675-ea4c-4cf4-827d-2274b22de565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:07.769867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301675-ea4c-4cf4-827d-2274b22de565 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:07.770175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301675-ea4c-4cf4-827d-2274b22de565 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:07.770441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05301675-ea4c-4cf4-827d-2274b22de565 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:07.780715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05301675-ea4c-4cf4-827d-2274b22de565 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:07.783126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05301675-ea4c-4cf4-827d-2274b22de565 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:07.800130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-05301675-ea4c-4cf4-827d-2274b22de565 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:07.801560 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 402/804] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:07.807738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98beaa-c911-4c11-90fb-865b79719b6a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:07.818113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c98beaa-c911-4c11-90fb-865b79719b6a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:07.822501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bd56a-ebc9-42de-80ce-72a4d0df53aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:07.823145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bd56a-ebc9-42de-80ce-72a4d0df53aa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:07.823425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bd56a-ebc9-42de-80ce-72a4d0df53aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:07.823697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01bd56a-ebc9-42de-80ce-72a4d0df53aa admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:07.824426 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bd56a-ebc9-42de-80ce-72a4d0df53aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:07.824731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bd56a-ebc9-42de-80ce-72a4d0df53aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:07.826332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01bd56a-ebc9-42de-80ce-72a4d0df53aa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:07.838772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 403/805] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:07.845068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301675-ea4c-4cf4-827d-2274b22de565 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:07.855026 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05301675-ea4c-4cf4-827d-2274b22de565 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:07.859524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648b4dd-cc70-477e-8bf7-c0ba5d18e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:07.860857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648b4dd-cc70-477e-8bf7-c0ba5d18e750 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:07.861220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648b4dd-cc70-477e-8bf7-c0ba5d18e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:07.861491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c648b4dd-cc70-477e-8bf7-c0ba5d18e750 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:07.869108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648b4dd-cc70-477e-8bf7-c0ba5d18e750 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:07.871077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c648b4dd-cc70-477e-8bf7-c0ba5d18e750 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:07.886116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-c648b4dd-cc70-477e-8bf7-c0ba5d18e750 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:01:07.887539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 403/806] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:01:07 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:07.893920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bd56a-ebc9-42de-80ce-72a4d0df53aa admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:07.903813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01bd56a-ebc9-42de-80ce-72a4d0df53aa admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:07.908756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3a036-86aa-48fc-8556-31412a1c15e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:07.909410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a036-86aa-48fc-8556-31412a1c15e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:07.909688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a036-86aa-48fc-8556-31412a1c15e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:07.909955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3a036-86aa-48fc-8556-31412a1c15e6 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:07.910838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3a036-86aa-48fc-8556-31412a1c15e6 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:07.911139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3a036-86aa-48fc-8556-31412a1c15e6 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:07.913021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3a036-86aa-48fc-8556-31412a1c15e6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:07.931447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 404/807] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Oct 27 01:01:07 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:07.937428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648b4dd-cc70-477e-8bf7-c0ba5d18e750 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:07.948226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c648b4dd-cc70-477e-8bf7-c0ba5d18e750 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:07.953082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26f72-f646-4d79-85b5-f43417d0471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:07.953976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26f72-f646-4d79-85b5-f43417d0471f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:07.954290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26f72-f646-4d79-85b5-f43417d0471f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:07.954560 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde26f72-f646-4d79-85b5-f43417d0471f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:07.966160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde26f72-f646-4d79-85b5-f43417d0471f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:07.968378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde26f72-f646-4d79-85b5-f43417d0471f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:07.993296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-cde26f72-f646-4d79-85b5-f43417d0471f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:08.000108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 404/808] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:07 2021] GET /identity/v3/domains/Default => generated 87 bytes in 63 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:08.007229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3a036-86aa-48fc-8556-31412a1c15e6 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.017179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3a036-86aa-48fc-8556-31412a1c15e6 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.022010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e978fb6-2fed-43bc-881e-829557f80a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.022761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e978fb6-2fed-43bc-881e-829557f80a98 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.023039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e978fb6-2fed-43bc-881e-829557f80a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.023310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e978fb6-2fed-43bc-881e-829557f80a98 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.024042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e978fb6-2fed-43bc-881e-829557f80a98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:08.024342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e978fb6-2fed-43bc-881e-829557f80a98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.025980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e978fb6-2fed-43bc-881e-829557f80a98 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.038049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 405/809] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:08.044223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26f72-f646-4d79-85b5-f43417d0471f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.054874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde26f72-f646-4d79-85b5-f43417d0471f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.059646 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c635c1-66cb-4bdc-8467-5042b3c8e944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.060418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c635c1-66cb-4bdc-8467-5042b3c8e944 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.060741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c635c1-66cb-4bdc-8467-5042b3c8e944 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.061011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c635c1-66cb-4bdc-8467-5042b3c8e944 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.068639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c635c1-66cb-4bdc-8467-5042b3c8e944 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.070597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c635c1-66cb-4bdc-8467-5042b3c8e944 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.083527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-01c635c1-66cb-4bdc-8467-5042b3c8e944 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:01:08.085026 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 405/810] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:08.091447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e978fb6-2fed-43bc-881e-829557f80a98 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.099306 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76341-6b4a-4b93-9218-ac7a7220b387 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.099598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76341-6b4a-4b93-9218-ac7a7220b387 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.099890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad76341-6b4a-4b93-9218-ac7a7220b387 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.101925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 406/811] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:08.102612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e978fb6-2fed-43bc-881e-829557f80a98 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.107607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e826-734f-4f91-a44a-5cf25554bd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.107820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ca9b-2b92-4f7b-9084-2a970a9f7bb1 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.108116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ca9b-2b92-4f7b-9084-2a970a9f7bb1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.108384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf5ca9b-2b92-4f7b-9084-2a970a9f7bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.109158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e826-734f-4f91-a44a-5cf25554bd2d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.109645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e826-734f-4f91-a44a-5cf25554bd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.110786 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06e826-734f-4f91-a44a-5cf25554bd2d admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.112290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e826-734f-4f91-a44a-5cf25554bd2d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:08.112872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e826-734f-4f91-a44a-5cf25554bd2d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.115032 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06e826-734f-4f91-a44a-5cf25554bd2d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.129111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-9cf5ca9b-2b92-4f7b-9084-2a970a9f7bb1 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:08.130007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 406/812] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:08.130850 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-9cf5ca9b-2b92-4f7b-9084-2a970a9f7bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:08.136518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e826-734f-4f91-a44a-5cf25554bd2d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.139462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 407/813] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:08 2021] POST /identity/v3/auth/tokens => generated 1816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:08.147413 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06e826-734f-4f91-a44a-5cf25554bd2d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.152484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a1d93-386b-45ff-af98-ba3b0588d7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.153662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a1d93-386b-45ff-af98-ba3b0588d7b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.154209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a1d93-386b-45ff-af98-ba3b0588d7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.154678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a1d93-386b-45ff-af98-ba3b0588d7b3 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/0a7c06728e9b49b68a4ea132f467c603/roles/f0e32f91782a4af6b2f454c61b696692` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.157838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a1d93-386b-45ff-af98-ba3b0588d7b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=0a7c06728e9b49b68a4ea132f467c603, role_id=f0e32f91782a4af6b2f454c61b696692)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.161014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a1d93-386b-45ff-af98-ba3b0588d7b3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.165248 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ca9b-2b92-4f7b-9084-2a970a9f7bb1 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.175581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf5ca9b-2b92-4f7b-9084-2a970a9f7bb1 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.180262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81ef74-ee3e-41f5-ba2a-ec28efe2fd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.180916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81ef74-ee3e-41f5-ba2a-ec28efe2fd69 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.181191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81ef74-ee3e-41f5-ba2a-ec28efe2fd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.181460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81ef74-ee3e-41f5-ba2a-ec28efe2fd69 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.183235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81ef74-ee3e-41f5-ba2a-ec28efe2fd69 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.183931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81ef74-ee3e-41f5-ba2a-ec28efe2fd69 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.243619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 407/814] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:01:08 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/0a7c06728e9b49b68a4ea132f467c603/roles/f0e32f91782a4af6b2f454c61b696692 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:01:08.300039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 408/815] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:01:08 2021] POST /identity/v3/services => generated 241 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:08.600160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113c487-c01d-4c86-aaa8-2de50e4308cf None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.600468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113c487-c01d-4c86-aaa8-2de50e4308cf None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.600709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f113c487-c01d-4c86-aaa8-2de50e4308cf None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.602782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 408/816] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:08.608901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905f650-33cd-4f4a-8950-d66bdb826f7c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.609189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905f650-33cd-4f4a-8950-d66bdb826f7c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.609471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5905f650-33cd-4f4a-8950-d66bdb826f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.624810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41ce7c-c60d-4cbd-89b7-6e2df3f38fc8 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.625117 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41ce7c-c60d-4cbd-89b7-6e2df3f38fc8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.625358 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41ce7c-c60d-4cbd-89b7-6e2df3f38fc8 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.627818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 409/817] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:08 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:01:08.631825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-5905f650-33cd-4f4a-8950-d66bdb826f7c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:08.633453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5905f650-33cd-4f4a-8950-d66bdb826f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:08.633639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a8cf5-86b1-4ca0-a961-895927e6d9ca None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.634049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a8cf5-86b1-4ca0-a961-895927e6d9ca None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.634433 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a8cf5-86b1-4ca0-a961-895927e6d9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.652170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e46a8cf5-86b1-4ca0-a961-895927e6d9ca None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:08.653500 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e46a8cf5-86b1-4ca0-a961-895927e6d9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:08.708920 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 409/818] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:08 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:08.718085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 410/819] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:08 2021] POST /identity/v3/auth/tokens => generated 1918 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:08.737182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905f650-33cd-4f4a-8950-d66bdb826f7c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.742095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a8cf5-86b1-4ca0-a961-895927e6d9ca None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.746977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5905f650-33cd-4f4a-8950-d66bdb826f7c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.751612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a8cf5-86b1-4ca0-a961-895927e6d9ca None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.753567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660988a-f76a-4a5b-ba9e-8c512ad17b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.754456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660988a-f76a-4a5b-ba9e-8c512ad17b99 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.754941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660988a-f76a-4a5b-ba9e-8c512ad17b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.755213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660988a-f76a-4a5b-ba9e-8c512ad17b99 admin admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.755861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660988a-f76a-4a5b-ba9e-8c512ad17b99 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.757648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8660988a-f76a-4a5b-ba9e-8c512ad17b99 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.758227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d5e14-5f51-4057-bed4-fb883ded549d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.759283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d5e14-5f51-4057-bed4-fb883ded549d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.759808 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d5e14-5f51-4057-bed4-fb883ded549d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.760276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d5e14-5f51-4057-bed4-fb883ded549d admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.761138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d5e14-5f51-4057-bed4-fb883ded549d admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.763059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6d5e14-5f51-4057-bed4-fb883ded549d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.770438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-8660988a-f76a-4a5b-ba9e-8c512ad17b99 admin admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 27 01:01:08.772121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 410/820] 10.222.0.32 () {56 vars in 1153 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/services/compute_legacy => generated 95 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:08.776031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-4f6d5e14-5f51-4057-bed4-fb883ded549d admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:01:08.777654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 411/821] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:08.783985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660988a-f76a-4a5b-ba9e-8c512ad17b99 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.785109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d5e14-5f51-4057-bed4-fb883ded549d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.788785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660988a-f76a-4a5b-ba9e-8c512ad17b99 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.794125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66abf42-7152-4289-8b34-51f8e8e1f34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.794813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66abf42-7152-4289-8b34-51f8e8e1f34d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.795077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66abf42-7152-4289-8b34-51f8e8e1f34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.795345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66abf42-7152-4289-8b34-51f8e8e1f34d admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.795986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d5e14-5f51-4057-bed4-fb883ded549d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.796096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66abf42-7152-4289-8b34-51f8e8e1f34d admin admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:08.796330 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66abf42-7152-4289-8b34-51f8e8e1f34d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.798061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66abf42-7152-4289-8b34-51f8e8e1f34d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.802324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf2d4a-804e-4dd3-a6f4-1423d133a975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.803241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2d4a-804e-4dd3-a6f4-1423d133a975 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.803420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 411/822] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:08.803916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2d4a-804e-4dd3-a6f4-1423d133a975 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.804441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bf2d4a-804e-4dd3-a6f4-1423d133a975 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.805359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf2d4a-804e-4dd3-a6f4-1423d133a975 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:08.805900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf2d4a-804e-4dd3-a6f4-1423d133a975 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.807793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bf2d4a-804e-4dd3-a6f4-1423d133a975 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.809678 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66abf42-7152-4289-8b34-51f8e8e1f34d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.813755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 412/823] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:08.819944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf2d4a-804e-4dd3-a6f4-1423d133a975 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.824059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66abf42-7152-4289-8b34-51f8e8e1f34d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.829817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864c2d-8d4d-4036-b344-11900ff1a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.830479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864c2d-8d4d-4036-b344-11900ff1a822 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.830752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864c2d-8d4d-4036-b344-11900ff1a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.831014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd864c2d-8d4d-4036-b344-11900ff1a822 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.831720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864c2d-8d4d-4036-b344-11900ff1a822 admin admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:08.832013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864c2d-8d4d-4036-b344-11900ff1a822 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.832302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bf2d4a-804e-4dd3-a6f4-1423d133a975 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.833645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd864c2d-8d4d-4036-b344-11900ff1a822 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.837582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb51ec-d865-4a67-b403-bfcc2b812868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.838511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb51ec-d865-4a67-b403-bfcc2b812868 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.838941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 412/824] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:08.839440 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb51ec-d865-4a67-b403-bfcc2b812868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.839913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb51ec-d865-4a67-b403-bfcc2b812868 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.840923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb51ec-d865-4a67-b403-bfcc2b812868 admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:08.841425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb51ec-d865-4a67-b403-bfcc2b812868 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.843303 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fb51ec-d865-4a67-b403-bfcc2b812868 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.846337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864c2d-8d4d-4036-b344-11900ff1a822 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.849951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 413/825] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:08.856353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb51ec-d865-4a67-b403-bfcc2b812868 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.856936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd864c2d-8d4d-4036-b344-11900ff1a822 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.862214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba41bc8-2585-4c9e-8d75-bcd161bc4f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.862844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba41bc8-2585-4c9e-8d75-bcd161bc4f38 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.863579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba41bc8-2585-4c9e-8d75-bcd161bc4f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.863866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba41bc8-2585-4c9e-8d75-bcd161bc4f38 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.865422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba41bc8-2585-4c9e-8d75-bcd161bc4f38 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.866436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-eba41bc8-2585-4c9e-8d75-bcd161bc4f38 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_endpoint failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:01:08.866436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:01:08.866436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:01:08.867278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba41bc8-2585-4c9e-8d75-bcd161bc4f38 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.868489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb51ec-d865-4a67-b403-bfcc2b812868 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.873588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cefb5-ae2a-4914-85ad-5efca834ea5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.874544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cefb5-ae2a-4914-85ad-5efca834ea5b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.875233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cefb5-ae2a-4914-85ad-5efca834ea5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.876265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5cefb5-ae2a-4914-85ad-5efca834ea5b admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.877881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cefb5-ae2a-4914-85ad-5efca834ea5b admin admin] RBAC: Adding query filter params (interface=public, service_id=63bbfa7fa03a4553ba78fdb8dbc8b35b, region_id=RegionOne) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:08.878558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cefb5-ae2a-4914-85ad-5efca834ea5b admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.880541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5cefb5-ae2a-4914-85ad-5efca834ea5b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.886050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 414/826] 10.222.0.32 () {56 vars in 1272 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/endpoints?service_id=63bbfa7fa03a4553ba78fdb8dbc8b35b&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:08.894169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cefb5-ae2a-4914-85ad-5efca834ea5b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:08.904184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5cefb5-ae2a-4914-85ad-5efca834ea5b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:08.908834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe0bb26-7b05-474f-9c86-560e77b1adc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:08.909551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0bb26-7b05-474f-9c86-560e77b1adc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:08.909941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0bb26-7b05-474f-9c86-560e77b1adc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:08.910338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe0bb26-7b05-474f-9c86-560e77b1adc4 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:08.911154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0bb26-7b05-474f-9c86-560e77b1adc4 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:08.912737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe0bb26-7b05-474f-9c86-560e77b1adc4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:08.922895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 415/827] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:01:08 2021] GET /identity/v3/services => generated 1497 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:01:08.961191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 413/828] 10.222.0.32 () {60 vars in 1165 bytes} [Wed Oct 27 01:01:08 2021] POST /identity/v3/endpoints => generated 347 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:01:10.587194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ff7bc-ac3b-4611-8e7b-134e758724b3 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.587723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ff7bc-ac3b-4611-8e7b-134e758724b3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.587723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9ff7bc-ac3b-4611-8e7b-134e758724b3 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.589724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 416/829] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:10.596446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf425d-160f-430a-a9b4-1de2c3160cbb None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.597206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf425d-160f-430a-a9b4-1de2c3160cbb None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.597640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf425d-160f-430a-a9b4-1de2c3160cbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.616037 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-61bf425d-160f-430a-a9b4-1de2c3160cbb None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:10.617420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-61bf425d-160f-430a-a9b4-1de2c3160cbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:10.635182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 414/830] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:10 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:10.642052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaaab9-c075-4950-bfda-aa3f31eba5db None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.642052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaaab9-c075-4950-bfda-aa3f31eba5db None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.642052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaaab9-c075-4950-bfda-aa3f31eba5db None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.642052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 417/831] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:10.647094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa81bf-91a2-4640-8b96-8d0106136f1b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.647533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa81bf-91a2-4640-8b96-8d0106136f1b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.647942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa81bf-91a2-4640-8b96-8d0106136f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.661166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaaab9-c075-4950-bfda-aa3f31eba5db None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.667348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-05fa81bf-91a2-4640-8b96-8d0106136f1b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:10.669498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-05fa81bf-91a2-4640-8b96-8d0106136f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:10.673766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaaab9-c075-4950-bfda-aa3f31eba5db None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.678268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07acc13-2af2-4342-a88f-6f41750ac2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.679062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07acc13-2af2-4342-a88f-6f41750ac2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.679337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07acc13-2af2-4342-a88f-6f41750ac2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.679605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07acc13-2af2-4342-a88f-6f41750ac2f1 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.680770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 415/832] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:10 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:10.695164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07acc13-2af2-4342-a88f-6f41750ac2f1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:10.702476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-b07acc13-2af2-4342-a88f-6f41750ac2f1 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:01:10.703657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 418/833] 10.222.0.32 () {56 vars in 1141 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 43 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:10.704329 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa81bf-91a2-4640-8b96-8d0106136f1b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.710750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07acc13-2af2-4342-a88f-6f41750ac2f1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.713510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa81bf-91a2-4640-8b96-8d0106136f1b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.717959 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7731163-2573-403a-8eff-996a5cc1d744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.718878 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7731163-2573-403a-8eff-996a5cc1d744 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.719148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7731163-2573-403a-8eff-996a5cc1d744 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.719992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7731163-2573-403a-8eff-996a5cc1d744 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.720890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7731163-2573-403a-8eff-996a5cc1d744 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.721669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07acc13-2af2-4342-a88f-6f41750ac2f1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.722603 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7731163-2573-403a-8eff-996a5cc1d744 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.726769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17be95-1041-4872-bcb9-eff53ae8e448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.727610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17be95-1041-4872-bcb9-eff53ae8e448 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.728027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17be95-1041-4872-bcb9-eff53ae8e448 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.728437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17be95-1041-4872-bcb9-eff53ae8e448 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.729332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17be95-1041-4872-bcb9-eff53ae8e448 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:10.729785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17be95-1041-4872-bcb9-eff53ae8e448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.731537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c17be95-1041-4872-bcb9-eff53ae8e448 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.735958 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-d7731163-2573-403a-8eff-996a5cc1d744 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:01:10.742070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 416/834] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/services/object-store => generated 93 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:10.743205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 419/835] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:10.749694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7731163-2573-403a-8eff-996a5cc1d744 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.751102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17be95-1041-4872-bcb9-eff53ae8e448 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.759941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7731163-2573-403a-8eff-996a5cc1d744 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.760760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c17be95-1041-4872-bcb9-eff53ae8e448 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.765201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ec9bf-82c8-42b5-b7ee-b18c8d997f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.765581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b3de9-f6fd-461b-a934-d719b803789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.766004 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ec9bf-82c8-42b5-b7ee-b18c8d997f8a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.766866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ec9bf-82c8-42b5-b7ee-b18c8d997f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.767207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195ec9bf-82c8-42b5-b7ee-b18c8d997f8a admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.767549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b3de9-f6fd-461b-a934-d719b803789d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.767972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b3de9-f6fd-461b-a934-d719b803789d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.768378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73b3de9-f6fd-461b-a934-d719b803789d admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.768566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ec9bf-82c8-42b5-b7ee-b18c8d997f8a admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:10.769174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ec9bf-82c8-42b5-b7ee-b18c8d997f8a admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.771262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195ec9bf-82c8-42b5-b7ee-b18c8d997f8a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.776925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 417/836] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:10.783628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b3de9-f6fd-461b-a934-d719b803789d admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.784115 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ec9bf-82c8-42b5-b7ee-b18c8d997f8a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.786004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73b3de9-f6fd-461b-a934-d719b803789d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.793494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195ec9bf-82c8-42b5-b7ee-b18c8d997f8a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.798258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b16e-183c-4864-ab35-8a1cc6a53102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.798903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b16e-183c-4864-ab35-8a1cc6a53102 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.799176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b16e-183c-4864-ab35-8a1cc6a53102 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.799445 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023b16e-183c-4864-ab35-8a1cc6a53102 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.800152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023b16e-183c-4864-ab35-8a1cc6a53102 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:10.800448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023b16e-183c-4864-ab35-8a1cc6a53102 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.802006 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023b16e-183c-4864-ab35-8a1cc6a53102 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.808488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-f73b3de9-f6fd-461b-a934-d719b803789d admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:10.810525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 420/838] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/domains/Default => generated 87 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:10.811290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 418/838] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:10.817435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b16e-183c-4864-ab35-8a1cc6a53102 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.818630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b3de9-f6fd-461b-a934-d719b803789d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.831517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023b16e-183c-4864-ab35-8a1cc6a53102 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.832848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73b3de9-f6fd-461b-a934-d719b803789d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.837131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174645c-42a6-4752-8d33-4229982e319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.837332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd56334-18f1-45fe-ad68-103167e53f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.837880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd56334-18f1-45fe-ad68-103167e53f43 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.838191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd56334-18f1-45fe-ad68-103167e53f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.838460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd56334-18f1-45fe-ad68-103167e53f43 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.839021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174645c-42a6-4752-8d33-4229982e319a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.839250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd56334-18f1-45fe-ad68-103167e53f43 admin admin] RBAC: Adding query filter params (interface=public, service_id=78d55205c1c045c99de9907ae9213a46, region_id=RegionOne) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:10.839553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd56334-18f1-45fe-ad68-103167e53f43 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.840117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174645c-42a6-4752-8d33-4229982e319a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.840780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174645c-42a6-4752-8d33-4229982e319a admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.841117 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd56334-18f1-45fe-ad68-103167e53f43 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.842362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174645c-42a6-4752-8d33-4229982e319a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:10.842864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174645c-42a6-4752-8d33-4229982e319a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.845216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174645c-42a6-4752-8d33-4229982e319a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.852137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 421/839] 10.222.0.32 () {56 vars in 1272 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/endpoints?service_id=78d55205c1c045c99de9907ae9213a46&interface=public®ion_id=RegionOne => generated 194 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:10.855002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd56334-18f1-45fe-ad68-103167e53f43 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.862651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 419/840] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:10.866195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd56334-18f1-45fe-ad68-103167e53f43 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.868802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174645c-42a6-4752-8d33-4229982e319a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.872208 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4b91e-0c89-4cf2-bb50-2a6ed99c8a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.873158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b91e-0c89-4cf2-bb50-2a6ed99c8a01 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.873836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b91e-0c89-4cf2-bb50-2a6ed99c8a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.874403 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b91e-0c89-4cf2-bb50-2a6ed99c8a01 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.876370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4b91e-0c89-4cf2-bb50-2a6ed99c8a01 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.878195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4b91e-0c89-4cf2-bb50-2a6ed99c8a01 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.878323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174645c-42a6-4752-8d33-4229982e319a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.883513 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bd05f-e845-4119-82af-edfb1e0c4971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.884346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bd05f-e845-4119-82af-edfb1e0c4971 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.884619 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bd05f-e845-4119-82af-edfb1e0c4971 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.884885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bd05f-e845-4119-82af-edfb1e0c4971 admin admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.894109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 422/841] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/services => generated 1497 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:01:10.900399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bd05f-e845-4119-82af-edfb1e0c4971 admin admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.902480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bd05f-e845-4119-82af-edfb1e0c4971 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.918443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-809bd05f-e845-4119-82af-edfb1e0c4971 admin admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 27 01:01:10.925355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 420/842] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/users/glance-swift => generated 90 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:10.926915 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4b91e-0c89-4cf2-bb50-2a6ed99c8a01 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.937138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4b91e-0c89-4cf2-bb50-2a6ed99c8a01 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:10.941721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59eea5-22c4-4829-939d-6326ecb57e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:10.942422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59eea5-22c4-4829-939d-6326ecb57e70 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:10.942700 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59eea5-22c4-4829-939d-6326ecb57e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:10.942968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59eea5-22c4-4829-939d-6326ecb57e70 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:10.943818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59eea5-22c4-4829-939d-6326ecb57e70 admin admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:10.944118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59eea5-22c4-4829-939d-6326ecb57e70 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:10.945957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a59eea5-22c4-4829-939d-6326ecb57e70 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:10.972759 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 423/843] 10.222.0.32 () {56 vars in 1170 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:10.974199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bd05f-e845-4119-82af-edfb1e0c4971 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:10.984166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bd05f-e845-4119-82af-edfb1e0c4971 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.002484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996054eb-ae6a-4b89-a2e8-c60bc4f975e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.003412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996054eb-ae6a-4b89-a2e8-c60bc4f975e0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.003918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996054eb-ae6a-4b89-a2e8-c60bc4f975e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.004386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996054eb-ae6a-4b89-a2e8-c60bc4f975e0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.013467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996054eb-ae6a-4b89-a2e8-c60bc4f975e0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.015629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996054eb-ae6a-4b89-a2e8-c60bc4f975e0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.027506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 421/844] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:10 2021] GET /identity/v3/auth/tokens => generated 2105 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:11.034795 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59eea5-22c4-4829-939d-6326ecb57e70 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.045107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a59eea5-22c4-4829-939d-6326ecb57e70 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.049981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8a5d2-b658-4ef8-87f0-c8f5481755b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.050800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8a5d2-b658-4ef8-87f0-c8f5481755b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.051075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8a5d2-b658-4ef8-87f0-c8f5481755b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.051341 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8a5d2-b658-4ef8-87f0-c8f5481755b9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.062725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8a5d2-b658-4ef8-87f0-c8f5481755b9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.064654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e8a5d2-b658-4ef8-87f0-c8f5481755b9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.083640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-f5e8a5d2-b658-4ef8-87f0-c8f5481755b9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:11.090246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 424/845] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/domains/Default => generated 87 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:11.091844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996054eb-ae6a-4b89-a2e8-c60bc4f975e0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.102253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996054eb-ae6a-4b89-a2e8-c60bc4f975e0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.107519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a6ee-e78f-4508-b525-42e24389b7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.108553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a6ee-e78f-4508-b525-42e24389b7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.109050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a6ee-e78f-4508-b525-42e24389b7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.109555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24a6ee-e78f-4508-b525-42e24389b7e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.110608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24a6ee-e78f-4508-b525-42e24389b7e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:11.111136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24a6ee-e78f-4508-b525-42e24389b7e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.113017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24a6ee-e78f-4508-b525-42e24389b7e4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.128330 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 422/846] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:11.134848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8a5d2-b658-4ef8-87f0-c8f5481755b9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.146166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8a5d2-b658-4ef8-87f0-c8f5481755b9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.151209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d34c0-2bff-4e1f-8847-f720c53d985f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.152107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d34c0-2bff-4e1f-8847-f720c53d985f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.152319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d34c0-2bff-4e1f-8847-f720c53d985f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.152584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53d34c0-2bff-4e1f-8847-f720c53d985f admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.160944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d34c0-2bff-4e1f-8847-f720c53d985f admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.162969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53d34c0-2bff-4e1f-8847-f720c53d985f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.177001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-c53d34c0-2bff-4e1f-8847-f720c53d985f admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:01:11.181175 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 425/847] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/projects/service => generated 88 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:11.185121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a6ee-e78f-4508-b525-42e24389b7e4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.195322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24a6ee-e78f-4508-b525-42e24389b7e4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.200074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1e01f7-d36c-421a-959f-7709084814b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.200796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e01f7-d36c-421a-959f-7709084814b8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.201073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e01f7-d36c-421a-959f-7709084814b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.201345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1e01f7-d36c-421a-959f-7709084814b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.202243 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e01f7-d36c-421a-959f-7709084814b8 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:11.202548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e01f7-d36c-421a-959f-7709084814b8 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.204782 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1e01f7-d36c-421a-959f-7709084814b8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.225563 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 423/848] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:11.227014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d34c0-2bff-4e1f-8847-f720c53d985f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.238906 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53d34c0-2bff-4e1f-8847-f720c53d985f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.243671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11ecfe6-1e5b-42b5-83df-3e9d94752a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.244319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ecfe6-1e5b-42b5-83df-3e9d94752a9f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.244640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ecfe6-1e5b-42b5-83df-3e9d94752a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.244905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11ecfe6-1e5b-42b5-83df-3e9d94752a9f admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.245793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ecfe6-1e5b-42b5-83df-3e9d94752a9f admin admin] RBAC: Adding query filter params (role.id=f0e32f91782a4af6b2f454c61b696692, scope.project.id=0a888473e9774db39941b0610769505a, user.id=0a7c06728e9b49b68a4ea132f467c603) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:11.246122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ecfe6-1e5b-42b5-83df-3e9d94752a9f admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.247995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11ecfe6-1e5b-42b5-83df-3e9d94752a9f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.262222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 426/849] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/role_assignments?user.id=0a7c06728e9b49b68a4ea132f467c603&scope.project.id=0a888473e9774db39941b0610769505a&role.id=f0e32f91782a4af6b2f454c61b696692 => generated 608 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:11.271010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efbbc5-eb33-4842-bef4-382fe1ca0576 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.271325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efbbc5-eb33-4842-bef4-382fe1ca0576 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.271840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5efbbc5-eb33-4842-bef4-382fe1ca0576 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.274136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 424/850] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:11.280667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881abf3-a866-4abf-853d-9d13a8b36f45 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.280950 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881abf3-a866-4abf-853d-9d13a8b36f45 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.281283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881abf3-a866-4abf-853d-9d13a8b36f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.301097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-7881abf3-a866-4abf-853d-9d13a8b36f45 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:11.302341 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7881abf3-a866-4abf-853d-9d13a8b36f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:11.310525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 427/851] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:11 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:11.334987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efbbc5-eb33-4842-bef4-382fe1ca0576 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.348864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5efbbc5-eb33-4842-bef4-382fe1ca0576 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.353708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c65038-4794-415b-a805-33a343862e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.354782 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c65038-4794-415b-a805-33a343862e89 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.355210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c65038-4794-415b-a805-33a343862e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.355655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c65038-4794-415b-a805-33a343862e89 admin admin] PATH_INFO: `/v3/services/volumev3` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.356476 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c65038-4794-415b-a805-33a343862e89 admin admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.358539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c65038-4794-415b-a805-33a343862e89 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.359213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e15c9-3a42-4aec-b9c9-59bdacb9d250 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.359624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e15c9-3a42-4aec-b9c9-59bdacb9d250 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.360063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e15c9-3a42-4aec-b9c9-59bdacb9d250 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.362962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 428/852] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:11 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:01:11.368853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3408a2-37be-4c79-8c61-747635c9b9a6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.369246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3408a2-37be-4c79-8c61-747635c9b9a6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.369610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3408a2-37be-4c79-8c61-747635c9b9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.371785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-92c65038-4794-415b-a805-33a343862e89 admin admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 27 01:01:11.373350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 425/853] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/services/volumev3 => generated 89 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:11.380174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c65038-4794-415b-a805-33a343862e89 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.389496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ba3408a2-37be-4c79-8c61-747635c9b9a6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:11.390275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c65038-4794-415b-a805-33a343862e89 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.390980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ba3408a2-37be-4c79-8c61-747635c9b9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:11.395385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a028acf-fdef-440a-a25d-48e84c069cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.396106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a028acf-fdef-440a-a25d-48e84c069cd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.396386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a028acf-fdef-440a-a25d-48e84c069cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.396963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a028acf-fdef-440a-a25d-48e84c069cd3 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.397703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a028acf-fdef-440a-a25d-48e84c069cd3 admin admin] RBAC: Adding query filter params (name=volumev3) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:11.398071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a028acf-fdef-440a-a25d-48e84c069cd3 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.399802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a028acf-fdef-440a-a25d-48e84c069cd3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.400200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 429/854] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:11 2021] POST /identity/v3/auth/tokens => generated 2105 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:11.405515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 426/855] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:11.412748 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3408a2-37be-4c79-8c61-747635c9b9a6 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.422436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3408a2-37be-4c79-8c61-747635c9b9a6 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.426089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a028acf-fdef-440a-a25d-48e84c069cd3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.431841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa69de5-9e80-4f39-8373-4014e1aeea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.433393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69de5-9e80-4f39-8373-4014e1aeea5d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.433779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69de5-9e80-4f39-8373-4014e1aeea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.434204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa69de5-9e80-4f39-8373-4014e1aeea5d admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.435436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa69de5-9e80-4f39-8373-4014e1aeea5d admin admin] RBAC: Adding query filter params (type=volumev3) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:11.435849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa69de5-9e80-4f39-8373-4014e1aeea5d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.437358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a028acf-fdef-440a-a25d-48e84c069cd3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.437787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa69de5-9e80-4f39-8373-4014e1aeea5d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.442641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629818a-6b71-4aeb-a0f6-6fcdc87301b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.443636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629818a-6b71-4aeb-a0f6-6fcdc87301b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.444060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629818a-6b71-4aeb-a0f6-6fcdc87301b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.444472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629818a-6b71-4aeb-a0f6-6fcdc87301b0 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.444963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 430/856] 10.222.0.32 () {56 vars in 1135 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:11.445469 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629818a-6b71-4aeb-a0f6-6fcdc87301b0 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.447314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629818a-6b71-4aeb-a0f6-6fcdc87301b0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.453930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa69de5-9e80-4f39-8373-4014e1aeea5d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.461858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-1629818a-6b71-4aeb-a0f6-6fcdc87301b0 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:01:11.469221 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 427/857] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/services/compute => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:11.469915 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa69de5-9e80-4f39-8373-4014e1aeea5d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.472238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb485dc1-ec9e-4e9a-af52-37df00bc63ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.472238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb485dc1-ec9e-4e9a-af52-37df00bc63ad admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.472238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb485dc1-ec9e-4e9a-af52-37df00bc63ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.472487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629818a-6b71-4aeb-a0f6-6fcdc87301b0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.472560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb485dc1-ec9e-4e9a-af52-37df00bc63ad admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.472560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb485dc1-ec9e-4e9a-af52-37df00bc63ad admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.473929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb485dc1-ec9e-4e9a-af52-37df00bc63ad admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.481951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629818a-6b71-4aeb-a0f6-6fcdc87301b0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.487472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64430c61-c12e-459a-abd7-10e4d25574a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.488123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64430c61-c12e-459a-abd7-10e4d25574a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.488413 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64430c61-c12e-459a-abd7-10e4d25574a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.488671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64430c61-c12e-459a-abd7-10e4d25574a8 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.489384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64430c61-c12e-459a-abd7-10e4d25574a8 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:11.489684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64430c61-c12e-459a-abd7-10e4d25574a8 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.491286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64430c61-c12e-459a-abd7-10e4d25574a8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.497025 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 428/858] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:11.502959 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64430c61-c12e-459a-abd7-10e4d25574a8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:11.512226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64430c61-c12e-459a-abd7-10e4d25574a8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:11.517330 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3835d951-391e-44ab-a32d-ad69f3091407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:11.518076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d951-391e-44ab-a32d-ad69f3091407 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:11.518505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d951-391e-44ab-a32d-ad69f3091407 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:11.518838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3835d951-391e-44ab-a32d-ad69f3091407 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:11.519616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835d951-391e-44ab-a32d-ad69f3091407 admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:11.519984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835d951-391e-44ab-a32d-ad69f3091407 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:11.521883 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3835d951-391e-44ab-a32d-ad69f3091407 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:11.527027 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 429/859] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:01:11 2021] GET /identity/v3/services?type=compute => generated 124 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:11.609497 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 431/860] 10.222.0.32 () {60 vars in 1165 bytes} [Wed Oct 27 01:01:11 2021] POST /identity/v3/endpoints => generated 346 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:13.297997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467f8e3-104e-4779-9757-c51b85cfb82e None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.298517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467f8e3-104e-4779-9757-c51b85cfb82e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.298824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8467f8e3-104e-4779-9757-c51b85cfb82e None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.300766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 430/861] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:13.307563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977032f-ddb6-4b65-a889-7919c0528a93 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.308398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977032f-ddb6-4b65-a889-7919c0528a93 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.308889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6977032f-ddb6-4b65-a889-7919c0528a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.327239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-6977032f-ddb6-4b65-a889-7919c0528a93 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:13.328783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-6977032f-ddb6-4b65-a889-7919c0528a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:13.346224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 432/862] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:13 2021] POST /identity/v3/auth/tokens => generated 2291 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:13.371252 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467f8e3-104e-4779-9757-c51b85cfb82e None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:13.384879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8467f8e3-104e-4779-9757-c51b85cfb82e None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:13.389671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33f57-2d70-404e-8ce9-87eead4425a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:13.390755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33f57-2d70-404e-8ce9-87eead4425a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.391306 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33f57-2d70-404e-8ce9-87eead4425a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.391776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33f57-2d70-404e-8ce9-87eead4425a4 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.392639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33f57-2d70-404e-8ce9-87eead4425a4 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:13.394471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33f57-2d70-404e-8ce9-87eead4425a4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:13.406625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-4ad33f57-2d70-404e-8ce9-87eead4425a4 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:01:13.408876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 431/863] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:13 2021] GET /identity/v3/services/object-store => generated 93 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:13.415792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977032f-ddb6-4b65-a889-7919c0528a93 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:13.425822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6977032f-ddb6-4b65-a889-7919c0528a93 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:13.430653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55492384-0548-465f-96ea-185fdbcf7baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:13.431530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55492384-0548-465f-96ea-185fdbcf7baf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.432031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55492384-0548-465f-96ea-185fdbcf7baf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.432501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55492384-0548-465f-96ea-185fdbcf7baf admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.433420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55492384-0548-465f-96ea-185fdbcf7baf admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:13.433944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55492384-0548-465f-96ea-185fdbcf7baf admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:13.435763 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55492384-0548-465f-96ea-185fdbcf7baf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:13.441692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 433/864] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:13 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:13.448343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33f57-2d70-404e-8ce9-87eead4425a4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:13.458444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33f57-2d70-404e-8ce9-87eead4425a4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:13.463406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bd53ff-c33f-442b-903e-983e546144d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:13.465117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd53ff-c33f-442b-903e-983e546144d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.465117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd53ff-c33f-442b-903e-983e546144d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.465117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bd53ff-c33f-442b-903e-983e546144d7 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.466119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd53ff-c33f-442b-903e-983e546144d7 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:13.466621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd53ff-c33f-442b-903e-983e546144d7 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:13.468404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bd53ff-c33f-442b-903e-983e546144d7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:13.474992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 432/865] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:13 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:13.481987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55492384-0548-465f-96ea-185fdbcf7baf admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:13.491940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55492384-0548-465f-96ea-185fdbcf7baf admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:13.496728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8428d3f9-3849-42a2-b7e3-8c742b5fd63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:13.497547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428d3f9-3849-42a2-b7e3-8c742b5fd63d admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.499476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428d3f9-3849-42a2-b7e3-8c742b5fd63d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.499476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428d3f9-3849-42a2-b7e3-8c742b5fd63d admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.499476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428d3f9-3849-42a2-b7e3-8c742b5fd63d admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:13.501025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8428d3f9-3849-42a2-b7e3-8c742b5fd63d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:13.616220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 434/866] 10.222.0.32 () {60 vars in 1165 bytes} [Wed Oct 27 01:01:13 2021] POST /identity/v3/endpoints => generated 349 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:01:13.732884 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725189e-d615-4891-8778-0bae3385e209 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.733214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725189e-d615-4891-8778-0bae3385e209 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.733438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725189e-d615-4891-8778-0bae3385e209 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.736107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 433/867] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:13.742783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b86b4-a0c0-4933-b397-c81402adb877 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.743430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b86b4-a0c0-4933-b397-c81402adb877 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.743910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b86b4-a0c0-4933-b397-c81402adb877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.763241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ee5b86b4-a0c0-4933-b397-c81402adb877 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:13.764809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ee5b86b4-a0c0-4933-b397-c81402adb877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:13.794177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 435/868] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:13 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:13.812856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725189e-d615-4891-8778-0bae3385e209 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:13.827532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725189e-d615-4891-8778-0bae3385e209 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:13.833767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700995e-4b41-44fa-9dda-223b0f680f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:13.835070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700995e-4b41-44fa-9dda-223b0f680f68 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.835565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700995e-4b41-44fa-9dda-223b0f680f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.836068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4700995e-4b41-44fa-9dda-223b0f680f68 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.837084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700995e-4b41-44fa-9dda-223b0f680f68 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:13.839090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4700995e-4b41-44fa-9dda-223b0f680f68 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:13.853162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b87f4-24d4-4e7d-b0fa-be51165b79b0 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.853491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b87f4-24d4-4e7d-b0fa-be51165b79b0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.853705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b87f4-24d4-4e7d-b0fa-be51165b79b0 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.854471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-4700995e-4b41-44fa-9dda-223b0f680f68 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:01:13.855859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 436/869] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:01:13.860638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 434/870] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Oct 27 01:01:13 2021] GET /identity/v3/services/image => generated 86 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:13.862368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14501-7128-4796-b94d-da76a9a51f86 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.862652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14501-7128-4796-b94d-da76a9a51f86 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.863169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a14501-7128-4796-b94d-da76a9a51f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.864082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700995e-4b41-44fa-9dda-223b0f680f68 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:13.875090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4700995e-4b41-44fa-9dda-223b0f680f68 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:13.880072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0626b9-7918-497d-adef-08dcc4a7b17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:13.880718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0626b9-7918-497d-adef-08dcc4a7b17c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.880992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0626b9-7918-497d-adef-08dcc4a7b17c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.881261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0626b9-7918-497d-adef-08dcc4a7b17c admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.881971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0626b9-7918-497d-adef-08dcc4a7b17c admin admin] RBAC: Adding query filter params (name=image) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:13.882298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0626b9-7918-497d-adef-08dcc4a7b17c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:13.883465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-61a14501-7128-4796-b94d-da76a9a51f86 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:13.883848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0626b9-7918-497d-adef-08dcc4a7b17c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:13.884659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-61a14501-7128-4796-b94d-da76a9a51f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:13.889744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 435/871] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:13 2021] GET /identity/v3/services?name=image => generated 122 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:13.894143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 437/872] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:13 2021] POST /identity/v3/auth/tokens => generated 2480 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:13.899041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0626b9-7918-497d-adef-08dcc4a7b17c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:13.909393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0626b9-7918-497d-adef-08dcc4a7b17c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:13.914157 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761924de-d4e8-45ff-a06c-e4444e7cfa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:13.915038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761924de-d4e8-45ff-a06c-e4444e7cfa2f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.915508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761924de-d4e8-45ff-a06c-e4444e7cfa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.915852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761924de-d4e8-45ff-a06c-e4444e7cfa2f admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.916638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761924de-d4e8-45ff-a06c-e4444e7cfa2f admin admin] RBAC: Adding query filter params (type=image) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:13.917011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761924de-d4e8-45ff-a06c-e4444e7cfa2f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:13.918387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14501-7128-4796-b94d-da76a9a51f86 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:13.923935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761924de-d4e8-45ff-a06c-e4444e7cfa2f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:13.927961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a14501-7128-4796-b94d-da76a9a51f86 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:13.929923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 436/873] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:13 2021] GET /identity/v3/services?type=image => generated 122 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:13.936790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7276-cae8-46de-8446-18b5af537f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:13.937771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7276-cae8-46de-8446-18b5af537f68 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.938492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7276-cae8-46de-8446-18b5af537f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.939224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a7276-cae8-46de-8446-18b5af537f68 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.940191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a7276-cae8-46de-8446-18b5af537f68 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:13.942140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18a7276-cae8-46de-8446-18b5af537f68 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:13.981168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e070f-6739-4fb9-8490-256fa88d81c9 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.981449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e070f-6739-4fb9-8490-256fa88d81c9 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.981721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e070f-6739-4fb9-8490-256fa88d81c9 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:13.987594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 437/874] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:13 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:01:13.994411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8558c-0819-4b72-80f3-f40f85a2ec90 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:13.994699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8558c-0819-4b72-80f3-f40f85a2ec90 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:13.994974 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8558c-0819-4b72-80f3-f40f85a2ec90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:14.016461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 438/875] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:01:13 2021] POST /identity/v3/services => generated 242 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:14.023306 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-66e8558c-0819-4b72-80f3-f40f85a2ec90 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:14.024559 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-66e8558c-0819-4b72-80f3-f40f85a2ec90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:14.051646 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 438/876] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:13 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:14.079244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7276-cae8-46de-8446-18b5af537f68 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:14.090753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a7276-cae8-46de-8446-18b5af537f68 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:14.095872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:14.096564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:14.096847 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:14.097165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:14.097933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:14.100021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:14.101536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.common [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 01:01:14.153587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.sql.core [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 27 01:01:14.153587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 27 01:01:14.153587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [parameters: {'id': '63a57a3e4f3f47369745cbd218a367b6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 27 01:01:14.153587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79889) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:01:14.161693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 63a57a3e4f3f47369745cbd218a367b6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 63a57a3e4f3f47369745cbd218a367b6. Oct 27 01:01:14.166173 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 439/877] 10.222.0.32 () {60 vars in 1161 bytes} [Wed Oct 27 01:01:14 2021] POST /identity/v3/projects => generated 262 bytes in 85 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:14.170351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8558c-0819-4b72-80f3-f40f85a2ec90 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:14.182388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8558c-0819-4b72-80f3-f40f85a2ec90 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:14.187825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a074d-6f8b-44fc-85a0-fe19b2cb8ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:14.188672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a074d-6f8b-44fc-85a0-fe19b2cb8ce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:14.188943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a074d-6f8b-44fc-85a0-fe19b2cb8ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:14.189204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a074d-6f8b-44fc-85a0-fe19b2cb8ce4 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:14.197755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a074d-6f8b-44fc-85a0-fe19b2cb8ce4 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:14.199821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a074d-6f8b-44fc-85a0-fe19b2cb8ce4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:14.214017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-dc1a074d-6f8b-44fc-85a0-fe19b2cb8ce4 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:01:14.215658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 439/878] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:14 2021] GET /identity/v3/projects/service => generated 88 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:14.223300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:14.234975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a83990-edcf-475d-b560-9a1d97a2e11e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:14.240626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5cdfa6-4fb0-4696-90d1-a4626e65bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:14.241283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cdfa6-4fb0-4696-90d1-a4626e65bab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:14.241565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cdfa6-4fb0-4696-90d1-a4626e65bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:14.241839 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5cdfa6-4fb0-4696-90d1-a4626e65bab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:14.242650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cdfa6-4fb0-4696-90d1-a4626e65bab1 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:14.242953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cdfa6-4fb0-4696-90d1-a4626e65bab1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:14.245047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5cdfa6-4fb0-4696-90d1-a4626e65bab1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:14.267472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 440/879] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:01:14 2021] GET /identity/v3/projects?name=service => generated 411 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:16.033327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e79f0-6dd0-4beb-ad23-90b8235e1570 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.033844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e79f0-6dd0-4beb-ad23-90b8235e1570 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.034137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e79f0-6dd0-4beb-ad23-90b8235e1570 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.036307 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 440/880] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:16 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:16.042790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab071fc3-1982-4191-b143-64de1a754762 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.043257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab071fc3-1982-4191-b143-64de1a754762 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.043530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab071fc3-1982-4191-b143-64de1a754762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.061792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ab071fc3-1982-4191-b143-64de1a754762 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:16.063385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ab071fc3-1982-4191-b143-64de1a754762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:16.071553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 441/881] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:16 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:16.096630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e79f0-6dd0-4beb-ad23-90b8235e1570 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.109545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e79f0-6dd0-4beb-ad23-90b8235e1570 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.114386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82a36d-53e7-4c8f-adc3-7ff2f85a0898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.115174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82a36d-53e7-4c8f-adc3-7ff2f85a0898 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.115445 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82a36d-53e7-4c8f-adc3-7ff2f85a0898 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.115711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82a36d-53e7-4c8f-adc3-7ff2f85a0898 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.116372 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82a36d-53e7-4c8f-adc3-7ff2f85a0898 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.117932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82a36d-53e7-4c8f-adc3-7ff2f85a0898 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.129568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-7d82a36d-53e7-4c8f-adc3-7ff2f85a0898 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:01:16.131035 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 441/882] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/services/object-store => generated 93 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:16.137711 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab071fc3-1982-4191-b143-64de1a754762 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.147972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab071fc3-1982-4191-b143-64de1a754762 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.152854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345966eb-379c-4ea4-b04e-2d166d809a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.153534 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345966eb-379c-4ea4-b04e-2d166d809a8e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.153810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345966eb-379c-4ea4-b04e-2d166d809a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.154123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345966eb-379c-4ea4-b04e-2d166d809a8e admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.154862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345966eb-379c-4ea4-b04e-2d166d809a8e admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:16.155163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345966eb-379c-4ea4-b04e-2d166d809a8e admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.157612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345966eb-379c-4ea4-b04e-2d166d809a8e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.163647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 442/883] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:16.170402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82a36d-53e7-4c8f-adc3-7ff2f85a0898 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.181029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82a36d-53e7-4c8f-adc3-7ff2f85a0898 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.185794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3952d-ce0a-41d0-be9c-d696918735de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.186486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3952d-ce0a-41d0-be9c-d696918735de admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.186760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3952d-ce0a-41d0-be9c-d696918735de admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.187030 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d3952d-ce0a-41d0-be9c-d696918735de admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.187754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3952d-ce0a-41d0-be9c-d696918735de admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:16.188662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3952d-ce0a-41d0-be9c-d696918735de admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.190268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d3952d-ce0a-41d0-be9c-d696918735de admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.195921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 442/884] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:16.202587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345966eb-379c-4ea4-b04e-2d166d809a8e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.212325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345966eb-379c-4ea4-b04e-2d166d809a8e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.216872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e8410-2ac8-4a32-a96b-aec75e77ff09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.217511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e8410-2ac8-4a32-a96b-aec75e77ff09 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.217788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e8410-2ac8-4a32-a96b-aec75e77ff09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.218086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e8410-2ac8-4a32-a96b-aec75e77ff09 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.218886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e8410-2ac8-4a32-a96b-aec75e77ff09 admin admin] RBAC: Adding query filter params (interface=admin, service_id=78d55205c1c045c99de9907ae9213a46, region_id=RegionOne) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:16.219266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e8410-2ac8-4a32-a96b-aec75e77ff09 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.220843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e8410-2ac8-4a32-a96b-aec75e77ff09 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.226395 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 443/885] 10.222.0.32 () {56 vars in 1270 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/endpoints?service_id=78d55205c1c045c99de9907ae9213a46&interface=admin®ion_id=RegionOne => generated 193 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:16.232971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3952d-ce0a-41d0-be9c-d696918735de admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.243759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d3952d-ce0a-41d0-be9c-d696918735de admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.248616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56386fa0-8977-40c8-924f-7f2f1ca8d513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.249296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56386fa0-8977-40c8-924f-7f2f1ca8d513 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.249569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56386fa0-8977-40c8-924f-7f2f1ca8d513 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.249836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56386fa0-8977-40c8-924f-7f2f1ca8d513 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.251447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56386fa0-8977-40c8-924f-7f2f1ca8d513 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.253105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56386fa0-8977-40c8-924f-7f2f1ca8d513 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.260545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 443/886] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/services => generated 1727 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:01:16.314728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f75aa1-3d79-4e3e-9ce6-06b2d4f50cf4 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.315053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f75aa1-3d79-4e3e-9ce6-06b2d4f50cf4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.315265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f75aa1-3d79-4e3e-9ce6-06b2d4f50cf4 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.317386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 444/887] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:16.324075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29dc73-70a6-4dcc-b88c-80fb8721fb25 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.324373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29dc73-70a6-4dcc-b88c-80fb8721fb25 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.324621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29dc73-70a6-4dcc-b88c-80fb8721fb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.343822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-6c29dc73-70a6-4dcc-b88c-80fb8721fb25 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:16.345549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6c29dc73-70a6-4dcc-b88c-80fb8721fb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:16.353695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 444/888] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:16 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:16.379046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f75aa1-3d79-4e3e-9ce6-06b2d4f50cf4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.392129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f75aa1-3d79-4e3e-9ce6-06b2d4f50cf4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.397213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1c388-c843-4f6f-90d4-5126f256b53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.397885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1c388-c843-4f6f-90d4-5126f256b53c admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.398213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1c388-c843-4f6f-90d4-5126f256b53c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.398484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1c388-c843-4f6f-90d4-5126f256b53c admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.399243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1c388-c843-4f6f-90d4-5126f256b53c admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.400878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1c388-c843-4f6f-90d4-5126f256b53c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.410818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083d7b-210f-41da-a171-25afc3a10fac None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.411144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083d7b-210f-41da-a171-25afc3a10fac None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.411416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe083d7b-210f-41da-a171-25afc3a10fac None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.413442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 445/889] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:01:16.419694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ef4d-1ea4-458c-b880-c2a7093f2509 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.419995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ef4d-1ea4-458c-b880-c2a7093f2509 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.428544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba2ef4d-1ea4-458c-b880-c2a7093f2509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.442363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2ba2ef4d-1ea4-458c-b880-c2a7093f2509 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:16.443552 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2ba2ef4d-1ea4-458c-b880-c2a7093f2509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:16.451751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 446/890] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:16 2021] POST /identity/v3/auth/tokens => generated 2576 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:16.476803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ef4d-1ea4-458c-b880-c2a7093f2509 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.488147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba2ef4d-1ea4-458c-b880-c2a7093f2509 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.492969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cea08-984a-4dc9-a273-2f51397653d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.493779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cea08-984a-4dc9-a273-2f51397653d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.494103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cea08-984a-4dc9-a273-2f51397653d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.494387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701cea08-984a-4dc9-a273-2f51397653d3 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.495106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cea08-984a-4dc9-a273-2f51397653d3 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.496768 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701cea08-984a-4dc9-a273-2f51397653d3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.508548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-701cea08-984a-4dc9-a273-2f51397653d3 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:01:16.509714 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 447/891] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/services/compute => generated 88 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:16.516226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cea08-984a-4dc9-a273-2f51397653d3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.526206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701cea08-984a-4dc9-a273-2f51397653d3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.530661 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04be9-5c2c-4808-9868-df533665a97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.531298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04be9-5c2c-4808-9868-df533665a97d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.532096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04be9-5c2c-4808-9868-df533665a97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.532887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04be9-5c2c-4808-9868-df533665a97d admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.533667 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df04be9-5c2c-4808-9868-df533665a97d admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:16.533969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df04be9-5c2c-4808-9868-df533665a97d admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.535554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df04be9-5c2c-4808-9868-df533665a97d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.547949 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 445/892] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:01:16 2021] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:01:16.549595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 448/893] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:16.555231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1c388-c843-4f6f-90d4-5126f256b53c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.577402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1c388-c843-4f6f-90d4-5126f256b53c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.582239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45602cbe-f03b-4aed-87d0-3f9f9c9de13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.582908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602cbe-f03b-4aed-87d0-3f9f9c9de13f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.583181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602cbe-f03b-4aed-87d0-3f9f9c9de13f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.583507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45602cbe-f03b-4aed-87d0-3f9f9c9de13f admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.584251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45602cbe-f03b-4aed-87d0-3f9f9c9de13f admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:16.584555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45602cbe-f03b-4aed-87d0-3f9f9c9de13f admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.586328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45602cbe-f03b-4aed-87d0-3f9f9c9de13f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.592393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 446/894] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:16.601284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04be9-5c2c-4808-9868-df533665a97d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.612225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04be9-5c2c-4808-9868-df533665a97d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.617300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384ba4b-7515-4cd7-bc9b-61775d7f81d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.618038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384ba4b-7515-4cd7-bc9b-61775d7f81d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.618363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384ba4b-7515-4cd7-bc9b-61775d7f81d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.618636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384ba4b-7515-4cd7-bc9b-61775d7f81d5 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.619455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384ba4b-7515-4cd7-bc9b-61775d7f81d5 admin admin] RBAC: Adding query filter params (interface=public, service_id=1de8175eb1cd447cad857916b4c716bb, region_id=RegionOne) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:16.619762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384ba4b-7515-4cd7-bc9b-61775d7f81d5 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.621495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384ba4b-7515-4cd7-bc9b-61775d7f81d5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.624951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d544f-452d-477e-a9cc-6a06232c3a32 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.625240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d544f-452d-477e-a9cc-6a06232c3a32 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.625703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d544f-452d-477e-a9cc-6a06232c3a32 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.628252 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 449/896] 10.222.0.32 () {56 vars in 1272 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/endpoints?service_id=1de8175eb1cd447cad857916b4c716bb&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:16.628415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 447/896] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:16.634773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384ba4b-7515-4cd7-bc9b-61775d7f81d5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.642269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872fd5-9d26-435b-a378-c3abce5c511b None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.642902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872fd5-9d26-435b-a378-c3abce5c511b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.648219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38872fd5-9d26-435b-a378-c3abce5c511b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.648348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384ba4b-7515-4cd7-bc9b-61775d7f81d5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.650852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067217e-69c2-426a-9e89-bb0584ad7763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.651541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067217e-69c2-426a-9e89-bb0584ad7763 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.651833 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067217e-69c2-426a-9e89-bb0584ad7763 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.652367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c067217e-69c2-426a-9e89-bb0584ad7763 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.653071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067217e-69c2-426a-9e89-bb0584ad7763 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.655775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c067217e-69c2-426a-9e89-bb0584ad7763 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.670054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 450/897] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/services => generated 1957 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:01:16.671553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-38872fd5-9d26-435b-a378-c3abce5c511b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:16.674002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-38872fd5-9d26-435b-a378-c3abce5c511b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:16.683072 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 448/898] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:16 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:16.710406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067217e-69c2-426a-9e89-bb0584ad7763 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.722331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c067217e-69c2-426a-9e89-bb0584ad7763 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.727394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.728246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.728626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.728955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.729817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.731889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.733663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.common [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 27 01:01:16.798848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.sql.core [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 27 01:01:16.798848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 27 01:01:16.798848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [parameters: {'user_id': '510b8e8babb44cad800fcdc28aa40d84', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 27 01:01:16.798848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=79890) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 27 01:01:16.814903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 27 01:01:16.816810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 451/899] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:01:16 2021] POST /identity/v3/users => generated 160 bytes in 107 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:16.823309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872fd5-9d26-435b-a378-c3abce5c511b None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.833893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38872fd5-9d26-435b-a378-c3abce5c511b None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.838954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74986486-2330-4652-ab5e-4a833f886ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.839887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74986486-2330-4652-ab5e-4a833f886ee3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.840277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74986486-2330-4652-ab5e-4a833f886ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.840674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74986486-2330-4652-ab5e-4a833f886ee3 admin admin] PATH_INFO: `/v3/users/cinder` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.849866 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74986486-2330-4652-ab5e-4a833f886ee3 admin admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.852062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74986486-2330-4652-ab5e-4a833f886ee3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.869583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-74986486-2330-4652-ab5e-4a833f886ee3 admin admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 27 01:01:16.871482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 449/900] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/users/cinder => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:16.878816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:16.892705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d37694-6fc9-4e2b-a8ae-d4ed8282d96c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:16.899013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb0f5e3-9da9-4059-8b9f-0e5016da0101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:16.899680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f5e3-9da9-4059-8b9f-0e5016da0101 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:16.899959 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f5e3-9da9-4059-8b9f-0e5016da0101 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:16.900233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb0f5e3-9da9-4059-8b9f-0e5016da0101 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:16.901052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f5e3-9da9-4059-8b9f-0e5016da0101 admin admin] RBAC: Adding query filter params (name=cinder) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:16.901357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f5e3-9da9-4059-8b9f-0e5016da0101 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:16.903615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb0f5e3-9da9-4059-8b9f-0e5016da0101 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:16.946544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 452/901] 10.222.0.32 () {56 vars in 1122 bytes} [Wed Oct 27 01:01:16 2021] GET /identity/v3/users?name=cinder => generated 354 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:18.592182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d1c2-ba3c-40ac-92c9-82152a1ffc90 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:18.592736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d1c2-ba3c-40ac-92c9-82152a1ffc90 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:18.592736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87d1c2-ba3c-40ac-92c9-82152a1ffc90 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:18.595409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 450/902] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:18.601418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71930ce-d3d8-47d7-a6e1-a6fde673f868 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:18.601807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71930ce-d3d8-47d7-a6e1-a6fde673f868 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:18.601964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71930ce-d3d8-47d7-a6e1-a6fde673f868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:18.620953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c71930ce-d3d8-47d7-a6e1-a6fde673f868 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:18.622499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c71930ce-d3d8-47d7-a6e1-a6fde673f868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:18.631281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 453/903] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:18 2021] POST /identity/v3/auth/tokens => generated 2672 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:18.656047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d1c2-ba3c-40ac-92c9-82152a1ffc90 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:18.668134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87d1c2-ba3c-40ac-92c9-82152a1ffc90 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:18.672434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45db5-0e6d-47d6-b4e4-9ab9c8963b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:18.673215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45db5-0e6d-47d6-b4e4-9ab9c8963b97 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:18.673490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45db5-0e6d-47d6-b4e4-9ab9c8963b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:18.673755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c45db5-0e6d-47d6-b4e4-9ab9c8963b97 admin admin] PATH_INFO: `/v3/services/object-store` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:18.674468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c45db5-0e6d-47d6-b4e4-9ab9c8963b97 admin admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:18.676059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c45db5-0e6d-47d6-b4e4-9ab9c8963b97 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:18.687107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-05c45db5-0e6d-47d6-b4e4-9ab9c8963b97 admin admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 27 01:01:18.689207 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 451/904] 10.222.0.32 () {56 vars in 1147 bytes} [Wed Oct 27 01:01:18 2021] GET /identity/v3/services/object-store => generated 93 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:18.695814 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71930ce-d3d8-47d7-a6e1-a6fde673f868 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:18.705241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71930ce-d3d8-47d7-a6e1-a6fde673f868 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:18.709731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec29b61-d2ae-49f0-9ecb-941cfbf57c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:18.710406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec29b61-d2ae-49f0-9ecb-941cfbf57c6b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:18.710683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec29b61-d2ae-49f0-9ecb-941cfbf57c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:18.710950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec29b61-d2ae-49f0-9ecb-941cfbf57c6b admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:18.711659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec29b61-d2ae-49f0-9ecb-941cfbf57c6b admin admin] RBAC: Adding query filter params (name=object-store) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:18.711958 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec29b61-d2ae-49f0-9ecb-941cfbf57c6b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:18.713530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec29b61-d2ae-49f0-9ecb-941cfbf57c6b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:18.718570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 454/905] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:18 2021] GET /identity/v3/services?name=object-store => generated 129 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:18.725361 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45db5-0e6d-47d6-b4e4-9ab9c8963b97 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:18.735499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c45db5-0e6d-47d6-b4e4-9ab9c8963b97 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:18.740244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343b3c6-fab1-433c-95b8-469c7389ce93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:18.740987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343b3c6-fab1-433c-95b8-469c7389ce93 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:18.741354 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343b3c6-fab1-433c-95b8-469c7389ce93 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:18.741712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343b3c6-fab1-433c-95b8-469c7389ce93 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:18.742599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343b3c6-fab1-433c-95b8-469c7389ce93 admin admin] RBAC: Adding query filter params (type=object-store) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:18.743012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343b3c6-fab1-433c-95b8-469c7389ce93 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:18.744714 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a343b3c6-fab1-433c-95b8-469c7389ce93 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:18.749816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 452/906] 10.222.0.32 () {56 vars in 1143 bytes} [Wed Oct 27 01:01:18 2021] GET /identity/v3/services?type=object-store => generated 356 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:18.756320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec29b61-d2ae-49f0-9ecb-941cfbf57c6b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:18.765762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec29b61-d2ae-49f0-9ecb-941cfbf57c6b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:18.770521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09f8954-30b6-490d-89bf-eade9e7e3367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:18.771195 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f8954-30b6-490d-89bf-eade9e7e3367 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:18.771724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f8954-30b6-490d-89bf-eade9e7e3367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:18.771994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09f8954-30b6-490d-89bf-eade9e7e3367 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:18.772769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f8954-30b6-490d-89bf-eade9e7e3367 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:18.774427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09f8954-30b6-490d-89bf-eade9e7e3367 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:18.871285 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 455/907] 10.222.0.32 () {60 vars in 1165 bytes} [Wed Oct 27 01:01:18 2021] POST /identity/v3/endpoints => generated 325 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:01:18.920818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa001-9895-444f-96b9-b7b6c1444b31 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:18.921261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa001-9895-444f-96b9-b7b6c1444b31 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:18.921651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0aa001-9895-444f-96b9-b7b6c1444b31 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:18.924830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 453/908] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:18 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:18.931587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87422f-ea4d-4a3c-97e1-72c7511b2087 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:18.931921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87422f-ea4d-4a3c-97e1-72c7511b2087 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:18.932203 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87422f-ea4d-4a3c-97e1-72c7511b2087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:18.950711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-5e87422f-ea4d-4a3c-97e1-72c7511b2087 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:18.951927 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5e87422f-ea4d-4a3c-97e1-72c7511b2087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:18.974075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 456/909] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:18 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:18.998761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa001-9895-444f-96b9-b7b6c1444b31 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:19.011904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0aa001-9895-444f-96b9-b7b6c1444b31 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:19.017186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103dd07-209c-4ad4-89ae-bc07e3647dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:19.018087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103dd07-209c-4ad4-89ae-bc07e3647dcb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.018432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103dd07-209c-4ad4-89ae-bc07e3647dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.018793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103dd07-209c-4ad4-89ae-bc07e3647dcb admin admin] PATH_INFO: `/v3/services/image` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.019532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103dd07-209c-4ad4-89ae-bc07e3647dcb admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:19.021454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103dd07-209c-4ad4-89ae-bc07e3647dcb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:19.027862 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03addce0-eaa5-4138-b59c-37da26e7d81c None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.028177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03addce0-eaa5-4138-b59c-37da26e7d81c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.028419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03addce0-eaa5-4138-b59c-37da26e7d81c None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.030475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 457/910] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:19 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:01:19.033862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-3103dd07-209c-4ad4-89ae-bc07e3647dcb admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:01:19.035291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 454/911] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Oct 27 01:01:18 2021] GET /identity/v3/services/image => generated 86 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:19.037783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30eeda-1111-4b19-8156-050c84725a4c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.038104 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30eeda-1111-4b19-8156-050c84725a4c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.038381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd30eeda-1111-4b19-8156-050c84725a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.042172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103dd07-209c-4ad4-89ae-bc07e3647dcb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:19.056941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-fd30eeda-1111-4b19-8156-050c84725a4c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:19.058218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-fd30eeda-1111-4b19-8156-050c84725a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:19.059292 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103dd07-209c-4ad4-89ae-bc07e3647dcb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:19.064183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4e784-5b80-4ee1-ad81-a76851e8b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:19.064857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4e784-5b80-4ee1-ad81-a76851e8b9f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.065137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4e784-5b80-4ee1-ad81-a76851e8b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.065411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c4e784-5b80-4ee1-ad81-a76851e8b9f9 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.066197 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4e784-5b80-4ee1-ad81-a76851e8b9f9 admin admin] RBAC: Adding query filter params (name=image) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:19.066535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4e784-5b80-4ee1-ad81-a76851e8b9f9 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:19.067285 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 458/912] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:19 2021] POST /identity/v3/auth/tokens => generated 2821 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:19.074198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c4e784-5b80-4ee1-ad81-a76851e8b9f9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:19.074198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 455/913] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:19 2021] GET /identity/v3/services?name=image => generated 122 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:19.080425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30eeda-1111-4b19-8156-050c84725a4c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:19.090391 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd30eeda-1111-4b19-8156-050c84725a4c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:19.091866 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4e784-5b80-4ee1-ad81-a76851e8b9f9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:19.096450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12916-a79b-4fba-ab50-92df28c89a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:19.097106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12916-a79b-4fba-ab50-92df28c89a88 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.097378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12916-a79b-4fba-ab50-92df28c89a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.097643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f12916-a79b-4fba-ab50-92df28c89a88 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.098639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12916-a79b-4fba-ab50-92df28c89a88 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:19.098952 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12916-a79b-4fba-ab50-92df28c89a88 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:19.101109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f12916-a79b-4fba-ab50-92df28c89a88 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:19.105796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c4e784-5b80-4ee1-ad81-a76851e8b9f9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:19.106303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 459/914] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:19 2021] GET /identity/v3/services?type=image => generated 350 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:19.113526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d485f8-7a9f-479b-9c95-8226f9128747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:19.113789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12916-a79b-4fba-ab50-92df28c89a88 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:19.114676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d485f8-7a9f-479b-9c95-8226f9128747 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.114965 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d485f8-7a9f-479b-9c95-8226f9128747 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.115213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d485f8-7a9f-479b-9c95-8226f9128747 admin admin] PATH_INFO: `/v3/services/compute` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.115883 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d485f8-7a9f-479b-9c95-8226f9128747 admin admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:19.117460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d485f8-7a9f-479b-9c95-8226f9128747 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:19.124864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f12916-a79b-4fba-ab50-92df28c89a88 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:19.128905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-c2d485f8-7a9f-479b-9c95-8226f9128747 admin admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 27 01:01:19.129967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d577384-de18-4899-9b59-ae45506296d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:19.130140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 456/915] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:19 2021] GET /identity/v3/services/compute => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:19.130986 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577384-de18-4899-9b59-ae45506296d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.131267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577384-de18-4899-9b59-ae45506296d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.131541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d577384-de18-4899-9b59-ae45506296d3 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.132341 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d577384-de18-4899-9b59-ae45506296d3 admin admin] RBAC: Adding query filter params (interface=public, service_id=727d5bacaf784ca69e621bd7670964f0, region_id=RegionOne) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:19.132651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d577384-de18-4899-9b59-ae45506296d3 admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:19.134251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d577384-de18-4899-9b59-ae45506296d3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:19.137372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d485f8-7a9f-479b-9c95-8226f9128747 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:19.139750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 460/916] 10.222.0.32 () {56 vars in 1272 bytes} [Wed Oct 27 01:01:19 2021] GET /identity/v3/endpoints?service_id=727d5bacaf784ca69e621bd7670964f0&interface=public®ion_id=RegionOne => generated 194 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:19.147885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d485f8-7a9f-479b-9c95-8226f9128747 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:19.148262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d577384-de18-4899-9b59-ae45506296d3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:19.152264 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e4bca-b0bd-4c3d-bc41-0b1dbc239585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:19.152921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e4bca-b0bd-4c3d-bc41-0b1dbc239585 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.153178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e4bca-b0bd-4c3d-bc41-0b1dbc239585 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.153447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7e4bca-b0bd-4c3d-bc41-0b1dbc239585 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.154204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e4bca-b0bd-4c3d-bc41-0b1dbc239585 admin admin] RBAC: Adding query filter params (name=compute) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:19.154505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e4bca-b0bd-4c3d-bc41-0b1dbc239585 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:19.156075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7e4bca-b0bd-4c3d-bc41-0b1dbc239585 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:19.158093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d577384-de18-4899-9b59-ae45506296d3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:19.162015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 457/917] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:01:19 2021] GET /identity/v3/services?name=compute => generated 124 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:19.162803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eab65b-8776-40d2-9cd3-b63fe6d698d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:19.163447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eab65b-8776-40d2-9cd3-b63fe6d698d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.163725 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eab65b-8776-40d2-9cd3-b63fe6d698d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.163992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eab65b-8776-40d2-9cd3-b63fe6d698d2 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.164674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eab65b-8776-40d2-9cd3-b63fe6d698d2 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:19.166250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18eab65b-8776-40d2-9cd3-b63fe6d698d2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:19.167965 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e4bca-b0bd-4c3d-bc41-0b1dbc239585 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:19.173298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 461/918] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:01:19 2021] GET /identity/v3/services => generated 1957 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:01:19.182351 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7e4bca-b0bd-4c3d-bc41-0b1dbc239585 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:19.186994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63753d8-546b-4387-a6f5-1506b7109e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:19.187659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63753d8-546b-4387-a6f5-1506b7109e8b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.187968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63753d8-546b-4387-a6f5-1506b7109e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.188238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63753d8-546b-4387-a6f5-1506b7109e8b admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.188970 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63753d8-546b-4387-a6f5-1506b7109e8b admin admin] RBAC: Adding query filter params (type=compute) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:19.189269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63753d8-546b-4387-a6f5-1506b7109e8b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:19.190931 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63753d8-546b-4387-a6f5-1506b7109e8b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:19.196807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 458/919] 10.222.0.32 () {56 vars in 1133 bytes} [Wed Oct 27 01:01:19 2021] GET /identity/v3/services?type=compute => generated 352 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:19.203244 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eab65b-8776-40d2-9cd3-b63fe6d698d2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:19.213725 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eab65b-8776-40d2-9cd3-b63fe6d698d2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:19.218383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3288e-7745-4adc-a305-34bd76e2330e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:19.219663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3288e-7745-4adc-a305-34bd76e2330e admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:19.220016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3288e-7745-4adc-a305-34bd76e2330e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:19.220287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3288e-7745-4adc-a305-34bd76e2330e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:19.221060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3288e-7745-4adc-a305-34bd76e2330e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:19.222685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3288e-7745-4adc-a305-34bd76e2330e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:19.310070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 462/920] 10.222.0.32 () {60 vars in 1165 bytes} [Wed Oct 27 01:01:19 2021] POST /identity/v3/endpoints => generated 334 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:21.176047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c74e4-67e8-440f-8746-9afe245f33c0 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.176591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c74e4-67e8-440f-8746-9afe245f33c0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.176591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96c74e4-67e8-440f-8746-9afe245f33c0 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.178501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 459/921] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:21.184402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8943c-e616-4497-88f6-ce4b726a3e21 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.184785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8943c-e616-4497-88f6-ce4b726a3e21 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.184974 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff8943c-e616-4497-88f6-ce4b726a3e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.202741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-4ff8943c-e616-4497-88f6-ce4b726a3e21 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:21.204731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4ff8943c-e616-4497-88f6-ce4b726a3e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:21.226082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 463/922] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:21 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:21.247549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c74e4-67e8-440f-8746-9afe245f33c0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.260078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96c74e4-67e8-440f-8746-9afe245f33c0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.264186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584d17e-3f99-42ca-a5f6-e735f199a73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.264952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d17e-3f99-42ca-a5f6-e735f199a73c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.265221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d17e-3f99-42ca-a5f6-e735f199a73c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.265483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584d17e-3f99-42ca-a5f6-e735f199a73c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.267356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584d17e-3f99-42ca-a5f6-e735f199a73c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.269003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584d17e-3f99-42ca-a5f6-e735f199a73c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.270746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 460/923] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/domains/default => generated 199 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:21.277416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8943c-e616-4497-88f6-ce4b726a3e21 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.286853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff8943c-e616-4497-88f6-ce4b726a3e21 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.291549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83a884-fb66-410c-b759-09be8fceade4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.292197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83a884-fb66-410c-b759-09be8fceade4 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.292473 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83a884-fb66-410c-b759-09be8fceade4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.292742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83a884-fb66-410c-b759-09be8fceade4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.293465 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83a884-fb66-410c-b759-09be8fceade4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.295390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83a884-fb66-410c-b759-09be8fceade4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.395929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 464/924] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:01:21 2021] POST /identity/v3/projects => generated 311 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:21.487947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea564ae-b46b-4295-abc5-4fffb38f46c8 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.488314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea564ae-b46b-4295-abc5-4fffb38f46c8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.488491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea564ae-b46b-4295-abc5-4fffb38f46c8 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.490526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 461/925] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:21.497005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb6df3-b474-42e7-8eae-91f3773adf87 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.497309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb6df3-b474-42e7-8eae-91f3773adf87 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.497569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb6df3-b474-42e7-8eae-91f3773adf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.517695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-b4cb6df3-b474-42e7-8eae-91f3773adf87 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:21.518879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b4cb6df3-b474-42e7-8eae-91f3773adf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:21.587242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 465/926] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:21 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:21.612755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea564ae-b46b-4295-abc5-4fffb38f46c8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.626969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea564ae-b46b-4295-abc5-4fffb38f46c8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.631379 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d9892d-dc10-4e64-961a-eb55c3fb9eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.632154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9892d-dc10-4e64-961a-eb55c3fb9eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.632433 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9892d-dc10-4e64-961a-eb55c3fb9eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.632723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9892d-dc10-4e64-961a-eb55c3fb9eb5 admin admin] PATH_INFO: `/v3/services/image` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.633365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9892d-dc10-4e64-961a-eb55c3fb9eb5 admin admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.634961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d9892d-dc10-4e64-961a-eb55c3fb9eb5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.647197 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-98d9892d-dc10-4e64-961a-eb55c3fb9eb5 admin admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 27 01:01:21.648437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 462/927] 10.222.0.32 () {56 vars in 1126 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/services/image => generated 86 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:21.655057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb6df3-b474-42e7-8eae-91f3773adf87 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.664765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb6df3-b474-42e7-8eae-91f3773adf87 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.669427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7b528-ffa0-47af-9189-f4a53613e29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.670149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7b528-ffa0-47af-9189-f4a53613e29b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.670425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7b528-ffa0-47af-9189-f4a53613e29b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.670698 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f7b528-ffa0-47af-9189-f4a53613e29b admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.671390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7b528-ffa0-47af-9189-f4a53613e29b admin admin] RBAC: Adding query filter params (name=image) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:21.671684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7b528-ffa0-47af-9189-f4a53613e29b admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.673424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f7b528-ffa0-47af-9189-f4a53613e29b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.678567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 466/928] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/services?name=image => generated 122 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:21.683482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f45df8-d586-452b-bba2-0aafdef29b07 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.683774 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f45df8-d586-452b-bba2-0aafdef29b07 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.684049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f45df8-d586-452b-bba2-0aafdef29b07 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.684919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7b528-ffa0-47af-9189-f4a53613e29b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.685803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 463/929] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:21 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:21.693214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dc647-0338-447e-a885-f02d0721bf68 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.693778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dc647-0338-447e-a885-f02d0721bf68 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.694099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dc647-0338-447e-a885-f02d0721bf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.695668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f7b528-ffa0-47af-9189-f4a53613e29b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.700220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63c0d0-9762-44c2-8a17-aca33e466625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.700863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63c0d0-9762-44c2-8a17-aca33e466625 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.701132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63c0d0-9762-44c2-8a17-aca33e466625 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.701396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63c0d0-9762-44c2-8a17-aca33e466625 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.702128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63c0d0-9762-44c2-8a17-aca33e466625 admin admin] RBAC: Adding query filter params (type=image) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:21.702424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63c0d0-9762-44c2-8a17-aca33e466625 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.704125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec63c0d0-9762-44c2-8a17-aca33e466625 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.709260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 467/930] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/services?type=image => generated 350 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:21.713112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-fc8dc647-0338-447e-a885-f02d0721bf68 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:21.714374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fc8dc647-0338-447e-a885-f02d0721bf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:21.715420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63c0d0-9762-44c2-8a17-aca33e466625 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.723339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 464/931] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:21 2021] POST /identity/v3/auth/tokens => generated 2977 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:21.726006 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63c0d0-9762-44c2-8a17-aca33e466625 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.730521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a9f7f-5d13-4037-8b7e-d3ba9c312a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.731219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a9f7f-5d13-4037-8b7e-d3ba9c312a39 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.731794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a9f7f-5d13-4037-8b7e-d3ba9c312a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.731897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a9f7f-5d13-4037-8b7e-d3ba9c312a39 admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.732682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a9f7f-5d13-4037-8b7e-d3ba9c312a39 admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.734334 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a9f7f-5d13-4037-8b7e-d3ba9c312a39 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.751275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dc647-0338-447e-a885-f02d0721bf68 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.761470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dc647-0338-447e-a885-f02d0721bf68 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.766180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b592ab8-95b9-41db-a70c-594344ca1124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.767127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b592ab8-95b9-41db-a70c-594344ca1124 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.767408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b592ab8-95b9-41db-a70c-594344ca1124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.767680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b592ab8-95b9-41db-a70c-594344ca1124 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.778300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b592ab8-95b9-41db-a70c-594344ca1124 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:21.786456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-0b592ab8-95b9-41db-a70c-594344ca1124 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:01:21.787653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 465/932] 10.222.0.32 () {56 vars in 1141 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:21.794076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b592ab8-95b9-41db-a70c-594344ca1124 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.805019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b592ab8-95b9-41db-a70c-594344ca1124 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.809497 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ceb86-ee61-4a06-939e-573ab4f25bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.810137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ceb86-ee61-4a06-939e-573ab4f25bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.810416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ceb86-ee61-4a06-939e-573ab4f25bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.810686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4ceb86-ee61-4a06-939e-573ab4f25bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.811494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ceb86-ee61-4a06-939e-573ab4f25bb1 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:21.811797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ceb86-ee61-4a06-939e-573ab4f25bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.813847 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4ceb86-ee61-4a06-939e-573ab4f25bb1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.822290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 466/933] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:21.834064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 468/934] 10.222.0.32 () {60 vars in 1165 bytes} [Wed Oct 27 01:01:21 2021] POST /identity/v3/endpoints => generated 327 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:21.834279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ceb86-ee61-4a06-939e-573ab4f25bb1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.839773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4ceb86-ee61-4a06-939e-573ab4f25bb1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.856739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b166953-5a2a-48eb-86b8-06a0e8e6fcca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.857738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166953-5a2a-48eb-86b8-06a0e8e6fcca admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.858189 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166953-5a2a-48eb-86b8-06a0e8e6fcca admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.858547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b166953-5a2a-48eb-86b8-06a0e8e6fcca admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.870619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b166953-5a2a-48eb-86b8-06a0e8e6fcca admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.872701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b166953-5a2a-48eb-86b8-06a0e8e6fcca admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.891201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-4b166953-5a2a-48eb-86b8-06a0e8e6fcca admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:21.892927 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 467/935] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/domains/Default => generated 87 bytes in 64 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:21.899602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a9f7f-5d13-4037-8b7e-d3ba9c312a39 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.911344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a9f7f-5d13-4037-8b7e-d3ba9c312a39 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.916109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510649e0-9239-4c37-81bb-d09df504d692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.916914 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510649e0-9239-4c37-81bb-d09df504d692 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.917320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510649e0-9239-4c37-81bb-d09df504d692 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.917693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510649e0-9239-4c37-81bb-d09df504d692 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.918584 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510649e0-9239-4c37-81bb-d09df504d692 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:21.918989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510649e0-9239-4c37-81bb-d09df504d692 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.920726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510649e0-9239-4c37-81bb-d09df504d692 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.934261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 469/936] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:21.941781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b166953-5a2a-48eb-86b8-06a0e8e6fcca admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:21.952237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b166953-5a2a-48eb-86b8-06a0e8e6fcca admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:21.958300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a031-c67b-4796-b495-0fd99db1228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:21.959194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a031-c67b-4796-b495-0fd99db1228c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:21.959538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a031-c67b-4796-b495-0fd99db1228c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:21.959870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a031-c67b-4796-b495-0fd99db1228c admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:21.968027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4a031-c67b-4796-b495-0fd99db1228c admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:21.970369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4a031-c67b-4796-b495-0fd99db1228c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:21.986267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-c6c4a031-c67b-4796-b495-0fd99db1228c admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:01:21.992966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 468/937] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/users/nova => generated 82 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:21.994206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510649e0-9239-4c37-81bb-d09df504d692 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:22.005233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510649e0-9239-4c37-81bb-d09df504d692 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:22.010129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31c237-86ee-4031-8e81-7ab0bf5b5554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:22.010808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31c237-86ee-4031-8e81-7ab0bf5b5554 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:22.011141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31c237-86ee-4031-8e81-7ab0bf5b5554 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:22.011411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d31c237-86ee-4031-8e81-7ab0bf5b5554 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:22.012321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31c237-86ee-4031-8e81-7ab0bf5b5554 admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:22.012627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31c237-86ee-4031-8e81-7ab0bf5b5554 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:22.014572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d31c237-86ee-4031-8e81-7ab0bf5b5554 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:22.036313 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 470/938] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Oct 27 01:01:21 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:22.041279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a031-c67b-4796-b495-0fd99db1228c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:22.052127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a031-c67b-4796-b495-0fd99db1228c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:22.057132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f826f9e-25ba-4ca4-8c4b-b899450e3d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:22.057759 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f826f9e-25ba-4ca4-8c4b-b899450e3d56 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:22.058043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f826f9e-25ba-4ca4-8c4b-b899450e3d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:22.058348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f826f9e-25ba-4ca4-8c4b-b899450e3d56 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:22.066507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f826f9e-25ba-4ca4-8c4b-b899450e3d56 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:22.068229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f826f9e-25ba-4ca4-8c4b-b899450e3d56 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:22.077212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 469/939] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:22 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:22.084428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31c237-86ee-4031-8e81-7ab0bf5b5554 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:22.095026 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d31c237-86ee-4031-8e81-7ab0bf5b5554 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:22.099536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b411c9-54b5-4fcb-8bee-85534357a1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:22.100381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b411c9-54b5-4fcb-8bee-85534357a1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:22.100727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b411c9-54b5-4fcb-8bee-85534357a1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:22.101064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b411c9-54b5-4fcb-8bee-85534357a1e8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:22.111324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b411c9-54b5-4fcb-8bee-85534357a1e8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:22.113183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b411c9-54b5-4fcb-8bee-85534357a1e8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:22.129429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-b7b411c9-54b5-4fcb-8bee-85534357a1e8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:22.130886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 471/940] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:22 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:22.136950 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f826f9e-25ba-4ca4-8c4b-b899450e3d56 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:22.146758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f826f9e-25ba-4ca4-8c4b-b899450e3d56 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:22.151142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f059a33-da54-444e-a511-89b41af4362f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:22.151780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f059a33-da54-444e-a511-89b41af4362f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:22.152052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f059a33-da54-444e-a511-89b41af4362f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:22.152315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f059a33-da54-444e-a511-89b41af4362f admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:22.153031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f059a33-da54-444e-a511-89b41af4362f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:22.153325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f059a33-da54-444e-a511-89b41af4362f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:22.154908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f059a33-da54-444e-a511-89b41af4362f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:22.166769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 470/941] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:22 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:22.172882 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b411c9-54b5-4fcb-8bee-85534357a1e8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:22.182404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b411c9-54b5-4fcb-8bee-85534357a1e8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:22.186857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc1418-6a97-444e-b132-add7be1d2608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:22.187681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1418-6a97-444e-b132-add7be1d2608 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:22.187953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1418-6a97-444e-b132-add7be1d2608 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:22.188214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cc1418-6a97-444e-b132-add7be1d2608 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:22.195308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc1418-6a97-444e-b132-add7be1d2608 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:22.197218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cc1418-6a97-444e-b132-add7be1d2608 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:22.210339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-a7cc1418-6a97-444e-b132-add7be1d2608 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:01:22.211702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 472/942] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:22 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:22.218055 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f059a33-da54-444e-a511-89b41af4362f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:22.227794 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f059a33-da54-444e-a511-89b41af4362f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:22.232613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca8914b-00df-4fd7-ae19-af3e849835bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:22.233366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8914b-00df-4fd7-ae19-af3e849835bc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:22.233742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8914b-00df-4fd7-ae19-af3e849835bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:22.234167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca8914b-00df-4fd7-ae19-af3e849835bc admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:22.235880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8914b-00df-4fd7-ae19-af3e849835bc admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:22.236291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8914b-00df-4fd7-ae19-af3e849835bc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:22.238262 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca8914b-00df-4fd7-ae19-af3e849835bc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:22.251423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 471/943] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:01:22 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:22.258387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc1418-6a97-444e-b132-add7be1d2608 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:22.268677 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cc1418-6a97-444e-b132-add7be1d2608 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:22.273382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fcb13-84b6-46ef-a9ba-54dffb35defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:22.274087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fcb13-84b6-46ef-a9ba-54dffb35defe admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:22.274308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fcb13-84b6-46ef-a9ba-54dffb35defe admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:22.274579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fcb13-84b6-46ef-a9ba-54dffb35defe admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:22.275416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fcb13-84b6-46ef-a9ba-54dffb35defe admin admin] RBAC: Adding query filter params (role.id=f0e32f91782a4af6b2f454c61b696692, scope.project.id=0a888473e9774db39941b0610769505a, user.id=d1596a916d784f6bb6e3b876f4820903) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:22.275721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fcb13-84b6-46ef-a9ba-54dffb35defe admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:22.277527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fcb13-84b6-46ef-a9ba-54dffb35defe admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:22.283278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 473/944] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:22 2021] GET /identity/v3/role_assignments?user.id=d1596a916d784f6bb6e3b876f4820903&scope.project.id=0a888473e9774db39941b0610769505a&role.id=f0e32f91782a4af6b2f454c61b696692 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:23.771760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d09e4-5990-45ad-a2a0-7710f055de0f None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:23.772279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d09e4-5990-45ad-a2a0-7710f055de0f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:23.772279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d09e4-5990-45ad-a2a0-7710f055de0f None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:23.774110 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 472/945] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:23 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:23.780322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba588fd-6810-418b-9fdf-eebe56374273 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:23.780698 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba588fd-6810-418b-9fdf-eebe56374273 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:23.780876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba588fd-6810-418b-9fdf-eebe56374273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:23.798732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-eba588fd-6810-418b-9fdf-eebe56374273 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:23.799922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-eba588fd-6810-418b-9fdf-eebe56374273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:23.807843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 474/946] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:23 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:23.834908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d09e4-5990-45ad-a2a0-7710f055de0f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:23.846987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d09e4-5990-45ad-a2a0-7710f055de0f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:23.851283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef22fe-6c16-4402-bad8-512c36520537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:23.852053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef22fe-6c16-4402-bad8-512c36520537 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:23.852330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef22fe-6c16-4402-bad8-512c36520537 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:23.852601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef22fe-6c16-4402-bad8-512c36520537 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:23.853770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef22fe-6c16-4402-bad8-512c36520537 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:23.855459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef22fe-6c16-4402-bad8-512c36520537 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:23.857063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 473/947] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:23 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:23.863876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba588fd-6810-418b-9fdf-eebe56374273 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:23.872809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba588fd-6810-418b-9fdf-eebe56374273 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:23.878073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744cbad-a356-4d36-a67d-0ab8cd7db4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:23.878723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744cbad-a356-4d36-a67d-0ab8cd7db4c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:23.879048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744cbad-a356-4d36-a67d-0ab8cd7db4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:23.879319 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744cbad-a356-4d36-a67d-0ab8cd7db4c1 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:23.880038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744cbad-a356-4d36-a67d-0ab8cd7db4c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:23.881901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744cbad-a356-4d36-a67d-0ab8cd7db4c1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.005637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 475/948] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:01:23 2021] POST /identity/v3/users => generated 285 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:24.132090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532c6b-52ba-424d-b4fe-d852dc2affca None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.132264 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532c6b-52ba-424d-b4fe-d852dc2affca None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.132547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22532c6b-52ba-424d-b4fe-d852dc2affca None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.134468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 474/949] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:24.141193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35171df-85bd-4dcb-be9c-7b67c0f9d4b9 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.141476 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35171df-85bd-4dcb-be9c-7b67c0f9d4b9 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.141756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35171df-85bd-4dcb-be9c-7b67c0f9d4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.161178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d35171df-85bd-4dcb-be9c-7b67c0f9d4b9 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:24.162411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d35171df-85bd-4dcb-be9c-7b67c0f9d4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:24.170419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 476/950] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:24.194693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532c6b-52ba-424d-b4fe-d852dc2affca None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.208146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22532c6b-52ba-424d-b4fe-d852dc2affca None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.212574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552d673-505f-4f96-9b46-fab385d60e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.213208 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d673-505f-4f96-9b46-fab385d60e2f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.213482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d673-505f-4f96-9b46-fab385d60e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.213749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552d673-505f-4f96-9b46-fab385d60e2f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.223373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552d673-505f-4f96-9b46-fab385d60e2f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.225092 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552d673-505f-4f96-9b46-fab385d60e2f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.233803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 475/951] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:24.246356 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35171df-85bd-4dcb-be9c-7b67c0f9d4b9 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.255485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35171df-85bd-4dcb-be9c-7b67c0f9d4b9 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.260766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7098249e-85cf-4448-ba89-7128e46a2f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.261544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098249e-85cf-4448-ba89-7128e46a2f18 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.261822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098249e-85cf-4448-ba89-7128e46a2f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.262124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7098249e-85cf-4448-ba89-7128e46a2f18 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.263317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098249e-85cf-4448-ba89-7128e46a2f18 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.264982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7098249e-85cf-4448-ba89-7128e46a2f18 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.267293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 477/952] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:24.531822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0767-c010-4911-a6cd-8c1d4f97aacc None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.532104 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0767-c010-4911-a6cd-8c1d4f97aacc None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.532371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ea0767-c010-4911-a6cd-8c1d4f97aacc None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.534394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 476/953] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:24.540489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1605de-db4c-470d-98a9-54242ed2c3f8 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.540772 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1605de-db4c-470d-98a9-54242ed2c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.541040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1605de-db4c-470d-98a9-54242ed2c3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.561451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-7c1605de-db4c-470d-98a9-54242ed2c3f8 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:24.563200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-7c1605de-db4c-470d-98a9-54242ed2c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:24.571176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 478/954] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:24 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:24.595205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea0767-c010-4911-a6cd-8c1d4f97aacc None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.607938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ea0767-c010-4911-a6cd-8c1d4f97aacc None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.615612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea48b20-d2a2-48e7-9611-f949fe3e78ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.616402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea48b20-d2a2-48e7-9611-f949fe3e78ff admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.616676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea48b20-d2a2-48e7-9611-f949fe3e78ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.616944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea48b20-d2a2-48e7-9611-f949fe3e78ff admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.627852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea48b20-d2a2-48e7-9611-f949fe3e78ff admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:24.635086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-bea48b20-d2a2-48e7-9611-f949fe3e78ff admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:01:24.636436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 477/955] 10.222.0.32 () {56 vars in 1141 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:24.644128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1605de-db4c-470d-98a9-54242ed2c3f8 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.653220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1605de-db4c-470d-98a9-54242ed2c3f8 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.658484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96061e-cb62-47ef-940e-91594f7747a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.659129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96061e-cb62-47ef-940e-91594f7747a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.659402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96061e-cb62-47ef-940e-91594f7747a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.659674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96061e-cb62-47ef-940e-91594f7747a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.660426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96061e-cb62-47ef-940e-91594f7747a4 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:24.660729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96061e-cb62-47ef-940e-91594f7747a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.662316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e96061e-cb62-47ef-940e-91594f7747a4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.671171 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 479/956] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:24.677940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea48b20-d2a2-48e7-9611-f949fe3e78ff admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.687990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea48b20-d2a2-48e7-9611-f949fe3e78ff admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.692396 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460405d-76fc-44b8-a5da-f345eb91fa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.693151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460405d-76fc-44b8-a5da-f345eb91fa2f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.693429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460405d-76fc-44b8-a5da-f345eb91fa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.693697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460405d-76fc-44b8-a5da-f345eb91fa2f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.703665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460405d-76fc-44b8-a5da-f345eb91fa2f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.705459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460405d-76fc-44b8-a5da-f345eb91fa2f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.722205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-5460405d-76fc-44b8-a5da-f345eb91fa2f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:24.728429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 478/957] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:24.729589 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96061e-cb62-47ef-940e-91594f7747a4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.740056 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96061e-cb62-47ef-940e-91594f7747a4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.744574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04cafc-84be-4428-88de-4c8ba5c7dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.745237 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04cafc-84be-4428-88de-4c8ba5c7dc6a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.745519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04cafc-84be-4428-88de-4c8ba5c7dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.745791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04cafc-84be-4428-88de-4c8ba5c7dc6a admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.746551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04cafc-84be-4428-88de-4c8ba5c7dc6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:24.746853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04cafc-84be-4428-88de-4c8ba5c7dc6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.748418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04cafc-84be-4428-88de-4c8ba5c7dc6a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.760137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 480/958] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:24.766637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460405d-76fc-44b8-a5da-f345eb91fa2f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.776443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460405d-76fc-44b8-a5da-f345eb91fa2f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.780939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce750288-5aee-4edb-81b2-ec547cb93d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.782605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce750288-5aee-4edb-81b2-ec547cb93d33 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.782852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce750288-5aee-4edb-81b2-ec547cb93d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.783107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce750288-5aee-4edb-81b2-ec547cb93d33 admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.790361 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce750288-5aee-4edb-81b2-ec547cb93d33 admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.792356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce750288-5aee-4edb-81b2-ec547cb93d33 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.806763 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-ce750288-5aee-4edb-81b2-ec547cb93d33 admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:01:24.808128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 479/959] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/users/nova => generated 82 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:24.814994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04cafc-84be-4428-88de-4c8ba5c7dc6a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.824504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04cafc-84be-4428-88de-4c8ba5c7dc6a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.829698 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed255917-af13-44ff-931a-7f03a03a968e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.830411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed255917-af13-44ff-931a-7f03a03a968e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.830728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed255917-af13-44ff-931a-7f03a03a968e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.831028 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed255917-af13-44ff-931a-7f03a03a968e admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.831974 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed255917-af13-44ff-931a-7f03a03a968e admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:24.832279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed255917-af13-44ff-931a-7f03a03a968e admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.834135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed255917-af13-44ff-931a-7f03a03a968e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.851403 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 481/960] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:24.857549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce750288-5aee-4edb-81b2-ec547cb93d33 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.867221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce750288-5aee-4edb-81b2-ec547cb93d33 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.871660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b73fa8-c4bf-49c9-8d96-75575031b6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.872429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b73fa8-c4bf-49c9-8d96-75575031b6a0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.872709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b73fa8-c4bf-49c9-8d96-75575031b6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.872987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b73fa8-c4bf-49c9-8d96-75575031b6a0 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.883808 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b73fa8-c4bf-49c9-8d96-75575031b6a0 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.885641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b73fa8-c4bf-49c9-8d96-75575031b6a0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.903376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-98b73fa8-c4bf-49c9-8d96-75575031b6a0 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:24.904683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 480/961] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:24.911260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed255917-af13-44ff-931a-7f03a03a968e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.920908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed255917-af13-44ff-931a-7f03a03a968e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.925525 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442afed-6acc-4afa-92c8-e75a41c73764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.926204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442afed-6acc-4afa-92c8-e75a41c73764 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.926481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442afed-6acc-4afa-92c8-e75a41c73764 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.926750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442afed-6acc-4afa-92c8-e75a41c73764 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.927488 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442afed-6acc-4afa-92c8-e75a41c73764 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:24.927791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442afed-6acc-4afa-92c8-e75a41c73764 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.929367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442afed-6acc-4afa-92c8-e75a41c73764 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.941225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 482/962] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:24.947427 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b73fa8-c4bf-49c9-8d96-75575031b6a0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:24.957522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b73fa8-c4bf-49c9-8d96-75575031b6a0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:24.961885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86faac6-8847-40cf-8b66-876de1c168ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:24.962686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86faac6-8847-40cf-8b66-876de1c168ec admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:24.962958 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86faac6-8847-40cf-8b66-876de1c168ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:24.963219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86faac6-8847-40cf-8b66-876de1c168ec admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:24.969904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86faac6-8847-40cf-8b66-876de1c168ec admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:24.971855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86faac6-8847-40cf-8b66-876de1c168ec admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:24.984181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-c86faac6-8847-40cf-8b66-876de1c168ec admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:01:24.985508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 481/963] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:24.991728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442afed-6acc-4afa-92c8-e75a41c73764 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:25.001910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442afed-6acc-4afa-92c8-e75a41c73764 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:25.006427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea63b88-dcd7-491a-b70e-d91538f5848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:25.007072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea63b88-dcd7-491a-b70e-d91538f5848f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:25.007352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea63b88-dcd7-491a-b70e-d91538f5848f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:25.007625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea63b88-dcd7-491a-b70e-d91538f5848f admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:25.008412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea63b88-dcd7-491a-b70e-d91538f5848f admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:25.008720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea63b88-dcd7-491a-b70e-d91538f5848f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:25.010611 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea63b88-dcd7-491a-b70e-d91538f5848f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:25.022897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 483/964] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:01:24 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:25.029419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86faac6-8847-40cf-8b66-876de1c168ec admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:25.039617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86faac6-8847-40cf-8b66-876de1c168ec admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:25.043883 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be42cb79-a76b-4876-b509-6947e2f16550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:25.044731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42cb79-a76b-4876-b509-6947e2f16550 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:25.045005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42cb79-a76b-4876-b509-6947e2f16550 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:25.045298 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be42cb79-a76b-4876-b509-6947e2f16550 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/d1596a916d784f6bb6e3b876f4820903/roles/f0e32f91782a4af6b2f454c61b696692` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:25.048012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42cb79-a76b-4876-b509-6947e2f16550 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=d1596a916d784f6bb6e3b876f4820903, role_id=f0e32f91782a4af6b2f454c61b696692)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:25.050630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be42cb79-a76b-4876-b509-6947e2f16550 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:25.173994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 482/965] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:01:25 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/d1596a916d784f6bb6e3b876f4820903/roles/f0e32f91782a4af6b2f454c61b696692 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:01:26.361299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae3167-52f8-4a9c-9d2e-39a319375888 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:26.361812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae3167-52f8-4a9c-9d2e-39a319375888 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:26.361812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae3167-52f8-4a9c-9d2e-39a319375888 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:26.363582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 484/966] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:26.369668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4d7cc-b2f9-4fff-b7ff-13fb1e5d4bf6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:26.370112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4d7cc-b2f9-4fff-b7ff-13fb1e5d4bf6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:26.370256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4d7cc-b2f9-4fff-b7ff-13fb1e5d4bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:26.388004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-25c4d7cc-b2f9-4fff-b7ff-13fb1e5d4bf6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:26.389172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-25c4d7cc-b2f9-4fff-b7ff-13fb1e5d4bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:26.446138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 483/967] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:26 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:26.472149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae3167-52f8-4a9c-9d2e-39a319375888 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:26.484458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae3167-52f8-4a9c-9d2e-39a319375888 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:26.488926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a01ca-fef1-4543-b3d5-99375c673ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:26.489692 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a01ca-fef1-4543-b3d5-99375c673ecb admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:26.489968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a01ca-fef1-4543-b3d5-99375c673ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:26.490267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a01ca-fef1-4543-b3d5-99375c673ecb admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:26.501126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a01ca-fef1-4543-b3d5-99375c673ecb admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:26.510195 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-444a01ca-fef1-4543-b3d5-99375c673ecb admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:01:26.513220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 485/968] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:01:26 2021] GET /identity/v3/roles/admin => generated 83 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:26.520854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4d7cc-b2f9-4fff-b7ff-13fb1e5d4bf6 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:26.530183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4d7cc-b2f9-4fff-b7ff-13fb1e5d4bf6 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:26.534929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d19539-571b-4142-a6bc-988cfa2513f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:26.535673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d19539-571b-4142-a6bc-988cfa2513f5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:26.536016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d19539-571b-4142-a6bc-988cfa2513f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:26.536353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d19539-571b-4142-a6bc-988cfa2513f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:26.537166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d19539-571b-4142-a6bc-988cfa2513f5 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:26.537472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d19539-571b-4142-a6bc-988cfa2513f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:26.539063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d19539-571b-4142-a6bc-988cfa2513f5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:26.547831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 484/969] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:01:26 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:26.553778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a01ca-fef1-4543-b3d5-99375c673ecb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:26.564551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a01ca-fef1-4543-b3d5-99375c673ecb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:26.569034 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e4f42-583a-4ae3-9c50-d310aadc1b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:26.569947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e4f42-583a-4ae3-9c50-d310aadc1b5e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:26.570272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e4f42-583a-4ae3-9c50-d310aadc1b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:26.570523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557e4f42-583a-4ae3-9c50-d310aadc1b5e admin admin] PATH_INFO: `/v3/users/1254388a078440299873aca35bcc973c` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:26.584942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e4f42-583a-4ae3-9c50-d310aadc1b5e admin admin] RBAC: Authorizing `identity:get_user(user_id=1254388a078440299873aca35bcc973c)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:26.587079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557e4f42-583a-4ae3-9c50-d310aadc1b5e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:26.588733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 486/970] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:26 2021] GET /identity/v3/users/1254388a078440299873aca35bcc973c => generated 285 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:26.595077 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d19539-571b-4142-a6bc-988cfa2513f5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:26.604547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d19539-571b-4142-a6bc-988cfa2513f5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:26.609045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbdc07-fc11-4554-87ee-cb8fdaa9e0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:26.610325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbdc07-fc11-4554-87ee-cb8fdaa9e0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:26.610658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbdc07-fc11-4554-87ee-cb8fdaa9e0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:26.610933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbdc07-fc11-4554-87ee-cb8fdaa9e0c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:26.618458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbdc07-fc11-4554-87ee-cb8fdaa9e0c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:26.620112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbdc07-fc11-4554-87ee-cb8fdaa9e0c9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:26.628725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 485/971] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:26 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:01:26.635175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e4f42-583a-4ae3-9c50-d310aadc1b5e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:26.644956 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557e4f42-583a-4ae3-9c50-d310aadc1b5e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:26.649587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8678df54-1f18-4da7-9c18-3e4c8bc9896c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:26.650427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678df54-1f18-4da7-9c18-3e4c8bc9896c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:26.650701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678df54-1f18-4da7-9c18-3e4c8bc9896c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:26.650970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8678df54-1f18-4da7-9c18-3e4c8bc9896c admin admin] PATH_INFO: `/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:26.652108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678df54-1f18-4da7-9c18-3e4c8bc9896c admin admin] RBAC: Authorizing `identity:get_project(project_id=f23eaa5ee4644267a1ca4bdd702bf2e1)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:26.654097 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8678df54-1f18-4da7-9c18-3e4c8bc9896c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:26.655745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 487/972] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:01:26 2021] GET /identity/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:26.662171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbdc07-fc11-4554-87ee-cb8fdaa9e0c9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:26.670801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbdc07-fc11-4554-87ee-cb8fdaa9e0c9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:26.675897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3af4418-4f43-4e15-a195-ce5fa8d0be59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:26.676505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af4418-4f43-4e15-a195-ce5fa8d0be59 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:26.676783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af4418-4f43-4e15-a195-ce5fa8d0be59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:26.677053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3af4418-4f43-4e15-a195-ce5fa8d0be59 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:26.677881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af4418-4f43-4e15-a195-ce5fa8d0be59 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1, user.id=1254388a078440299873aca35bcc973c) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:26.678225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af4418-4f43-4e15-a195-ce5fa8d0be59 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:26.680024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3af4418-4f43-4e15-a195-ce5fa8d0be59 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:26.687858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 486/973] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:26 2021] GET /identity/v3/role_assignments?user.id=1254388a078440299873aca35bcc973c&scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:27.391757 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0263-056a-4414-bc51-1eb5462bff1a None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.392260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0263-056a-4414-bc51-1eb5462bff1a None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.392352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bc0263-056a-4414-bc51-1eb5462bff1a None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.394070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 488/974] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:27.400148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc68dd7-e327-4bd7-877f-a7af63971e25 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.400553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc68dd7-e327-4bd7-877f-a7af63971e25 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.400702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc68dd7-e327-4bd7-877f-a7af63971e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.418241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8dc68dd7-e327-4bd7-877f-a7af63971e25 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:27.419429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8dc68dd7-e327-4bd7-877f-a7af63971e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:27.427597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 487/975] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:27 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:27.452074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc0263-056a-4414-bc51-1eb5462bff1a None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.463972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bc0263-056a-4414-bc51-1eb5462bff1a None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.468343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3a608-2d5d-446c-99ab-7ec511323006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.469123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3a608-2d5d-446c-99ab-7ec511323006 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.469398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3a608-2d5d-446c-99ab-7ec511323006 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.469665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc3a608-2d5d-446c-99ab-7ec511323006 admin admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.479520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc3a608-2d5d-446c-99ab-7ec511323006 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:27.487199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-efc3a608-2d5d-446c-99ab-7ec511323006 admin admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 27 01:01:27.488371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 489/976] 10.222.0.32 () {56 vars in 1141 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:27.494844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc68dd7-e327-4bd7-877f-a7af63971e25 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.504275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc68dd7-e327-4bd7-877f-a7af63971e25 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.508714 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a31c8e-bc6b-40b3-b385-877b145cd405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.509362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a31c8e-bc6b-40b3-b385-877b145cd405 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.509638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a31c8e-bc6b-40b3-b385-877b145cd405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.509908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a31c8e-bc6b-40b3-b385-877b145cd405 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.510692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a31c8e-bc6b-40b3-b385-877b145cd405 admin admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:27.510995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a31c8e-bc6b-40b3-b385-877b145cd405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.512576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a31c8e-bc6b-40b3-b385-877b145cd405 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.521101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 488/977] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:27.527381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3a608-2d5d-446c-99ab-7ec511323006 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.537539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc3a608-2d5d-446c-99ab-7ec511323006 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.542048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c25d71-1b6a-4a8e-93f0-6660227e8384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.542818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c25d71-1b6a-4a8e-93f0-6660227e8384 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.543093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c25d71-1b6a-4a8e-93f0-6660227e8384 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.543363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c25d71-1b6a-4a8e-93f0-6660227e8384 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.553925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c25d71-1b6a-4a8e-93f0-6660227e8384 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.555771 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c25d71-1b6a-4a8e-93f0-6660227e8384 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.573273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e4c25d71-1b6a-4a8e-93f0-6660227e8384 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:27.574608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 490/978] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:27.580936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a31c8e-bc6b-40b3-b385-877b145cd405 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.590465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a31c8e-bc6b-40b3-b385-877b145cd405 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.595073 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330c373-7d19-4dca-a3b0-3ca0b48a3273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.595806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330c373-7d19-4dca-a3b0-3ca0b48a3273 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.596182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330c373-7d19-4dca-a3b0-3ca0b48a3273 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.596528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330c373-7d19-4dca-a3b0-3ca0b48a3273 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.597359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330c373-7d19-4dca-a3b0-3ca0b48a3273 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:27.597729 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330c373-7d19-4dca-a3b0-3ca0b48a3273 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.599419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d330c373-7d19-4dca-a3b0-3ca0b48a3273 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.611607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 489/979] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:27.617770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c25d71-1b6a-4a8e-93f0-6660227e8384 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.627561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c25d71-1b6a-4a8e-93f0-6660227e8384 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.632028 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d311eb-c602-4c04-9f4c-970c93583c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.632791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d311eb-c602-4c04-9f4c-970c93583c2b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.633066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d311eb-c602-4c04-9f4c-970c93583c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.633335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d311eb-c602-4c04-9f4c-970c93583c2b admin admin] PATH_INFO: `/v3/users/nova` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.640419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d311eb-c602-4c04-9f4c-970c93583c2b admin admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.642553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d311eb-c602-4c04-9f4c-970c93583c2b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.655881 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-f6d311eb-c602-4c04-9f4c-970c93583c2b admin admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 27 01:01:27.657503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 491/980] 10.222.0.32 () {56 vars in 1114 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/users/nova => generated 82 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:27.663785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330c373-7d19-4dca-a3b0-3ca0b48a3273 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.674052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330c373-7d19-4dca-a3b0-3ca0b48a3273 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.678418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217ccb-ac81-4156-a617-3c8b2f1a998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.679062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217ccb-ac81-4156-a617-3c8b2f1a998b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.679344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217ccb-ac81-4156-a617-3c8b2f1a998b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.679613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38217ccb-ac81-4156-a617-3c8b2f1a998b admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.680446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217ccb-ac81-4156-a617-3c8b2f1a998b admin admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:27.680765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217ccb-ac81-4156-a617-3c8b2f1a998b admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.682594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38217ccb-ac81-4156-a617-3c8b2f1a998b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.699587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 490/981] 10.222.0.32 () {56 vars in 1154 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:27.706493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d311eb-c602-4c04-9f4c-970c93583c2b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.715861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d311eb-c602-4c04-9f4c-970c93583c2b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.720918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ae35f-2872-4756-9c73-85f43466ae92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.721543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae35f-2872-4756-9c73-85f43466ae92 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.721819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae35f-2872-4756-9c73-85f43466ae92 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.722126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334ae35f-2872-4756-9c73-85f43466ae92 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.729741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ae35f-2872-4756-9c73-85f43466ae92 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.731480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334ae35f-2872-4756-9c73-85f43466ae92 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.740131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 492/982] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:27.746496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217ccb-ac81-4156-a617-3c8b2f1a998b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.756657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38217ccb-ac81-4156-a617-3c8b2f1a998b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.761092 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454d8c5-8135-4ea9-b1c0-83c63d742fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.761871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454d8c5-8135-4ea9-b1c0-83c63d742fe8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.762184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454d8c5-8135-4ea9-b1c0-83c63d742fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.762451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454d8c5-8135-4ea9-b1c0-83c63d742fe8 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.773261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454d8c5-8135-4ea9-b1c0-83c63d742fe8 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.775107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454d8c5-8135-4ea9-b1c0-83c63d742fe8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.791297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-8454d8c5-8135-4ea9-b1c0-83c63d742fe8 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:01:27.792449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 491/983] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:27.799942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ae35f-2872-4756-9c73-85f43466ae92 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.810747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334ae35f-2872-4756-9c73-85f43466ae92 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.816329 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d21b2-2a18-4186-b4bf-c0da9730a9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.816983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d21b2-2a18-4186-b4bf-c0da9730a9bf admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.817269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d21b2-2a18-4186-b4bf-c0da9730a9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.817541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d21b2-2a18-4186-b4bf-c0da9730a9bf admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.818300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d21b2-2a18-4186-b4bf-c0da9730a9bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:27.818602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d21b2-2a18-4186-b4bf-c0da9730a9bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.820181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1d21b2-2a18-4186-b4bf-c0da9730a9bf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.832821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 493/984] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:27.839652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454d8c5-8135-4ea9-b1c0-83c63d742fe8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.850359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454d8c5-8135-4ea9-b1c0-83c63d742fe8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.854928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c383fe-4f09-4edf-a2cd-0ed94406363e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.855709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c383fe-4f09-4edf-a2cd-0ed94406363e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.855989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c383fe-4f09-4edf-a2cd-0ed94406363e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.856256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c383fe-4f09-4edf-a2cd-0ed94406363e admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.863641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c383fe-4f09-4edf-a2cd-0ed94406363e admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.865595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c383fe-4f09-4edf-a2cd-0ed94406363e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.879071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-a8c383fe-4f09-4edf-a2cd-0ed94406363e admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:01:27.880370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 492/985] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/projects/service => generated 88 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:27.886927 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d21b2-2a18-4186-b4bf-c0da9730a9bf admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.896639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d21b2-2a18-4186-b4bf-c0da9730a9bf admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.900984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb87b4-b0c4-45e8-abaf-87f4d06935bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.901615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb87b4-b0c4-45e8-abaf-87f4d06935bd admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.901889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb87b4-b0c4-45e8-abaf-87f4d06935bd admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.902187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb87b4-b0c4-45e8-abaf-87f4d06935bd admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.902977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb87b4-b0c4-45e8-abaf-87f4d06935bd admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:27.903275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb87b4-b0c4-45e8-abaf-87f4d06935bd admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.905066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb87b4-b0c4-45e8-abaf-87f4d06935bd admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.917485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 494/986] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:27.925215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c383fe-4f09-4edf-a2cd-0ed94406363e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:27.935475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c383fe-4f09-4edf-a2cd-0ed94406363e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:27.940105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1bb40-0015-4fdd-9fc0-646a8c7d6e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:27.940736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1bb40-0015-4fdd-9fc0-646a8c7d6e62 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:27.941016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1bb40-0015-4fdd-9fc0-646a8c7d6e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:27.941286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1bb40-0015-4fdd-9fc0-646a8c7d6e62 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:27.942165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1bb40-0015-4fdd-9fc0-646a8c7d6e62 admin admin] RBAC: Adding query filter params (role.id=f0e32f91782a4af6b2f454c61b696692, scope.project.id=0a888473e9774db39941b0610769505a, user.id=d1596a916d784f6bb6e3b876f4820903) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:27.942474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1bb40-0015-4fdd-9fc0-646a8c7d6e62 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:27.944293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1bb40-0015-4fdd-9fc0-646a8c7d6e62 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:27.950128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 493/987] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:27 2021] GET /identity/v3/role_assignments?user.id=d1596a916d784f6bb6e3b876f4820903&scope.project.id=0a888473e9774db39941b0610769505a&role.id=f0e32f91782a4af6b2f454c61b696692 => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:28.917427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fa345-94fe-4454-a642-6ec6f0e2591e None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:28.917960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fa345-94fe-4454-a642-6ec6f0e2591e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:28.917960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fa345-94fe-4454-a642-6ec6f0e2591e None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:28.919810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 495/988] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:28.925867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ab745-3495-4dae-be9d-0e44a8b6c935 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:28.926296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ab745-3495-4dae-be9d-0e44a8b6c935 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:28.926447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ab745-3495-4dae-be9d-0e44a8b6c935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:28.943212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-753ab745-3495-4dae-be9d-0e44a8b6c935 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:28.944385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-753ab745-3495-4dae-be9d-0e44a8b6c935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:28.951783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 494/989] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:28.975827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fa345-94fe-4454-a642-6ec6f0e2591e None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:28.987957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fa345-94fe-4454-a642-6ec6f0e2591e None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:28.992239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ff84b-f811-468e-aa0d-a4eb96df19a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:28.993003 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ff84b-f811-468e-aa0d-a4eb96df19a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:28.993278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ff84b-f811-468e-aa0d-a4eb96df19a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:28.993546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ff84b-f811-468e-aa0d-a4eb96df19a9 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:29.003861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3ff84b-f811-468e-aa0d-a4eb96df19a9 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:29.010623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-ba3ff84b-f811-468e-aa0d-a4eb96df19a9 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:01:29.011771 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 496/990] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:01:28 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:29.019072 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ab745-3495-4dae-be9d-0e44a8b6c935 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:29.027998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ab745-3495-4dae-be9d-0e44a8b6c935 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:29.032897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb62ed-64d0-4146-835c-4a9a4d8e2d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:29.033538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb62ed-64d0-4146-835c-4a9a4d8e2d25 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:29.033814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb62ed-64d0-4146-835c-4a9a4d8e2d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:29.034116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fb62ed-64d0-4146-835c-4a9a4d8e2d25 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:29.034860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb62ed-64d0-4146-835c-4a9a4d8e2d25 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:29.035158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb62ed-64d0-4146-835c-4a9a4d8e2d25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:29.036715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fb62ed-64d0-4146-835c-4a9a4d8e2d25 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:29.044622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 495/991] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:01:29 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:29.050796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ff84b-f811-468e-aa0d-a4eb96df19a9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:29.060523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ff84b-f811-468e-aa0d-a4eb96df19a9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:29.065001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e1226-a163-4af5-ac01-6c0d1a0d19ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:29.065816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1226-a163-4af5-ac01-6c0d1a0d19ec admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:29.066114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1226-a163-4af5-ac01-6c0d1a0d19ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:29.066382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e1226-a163-4af5-ac01-6c0d1a0d19ec admin admin] PATH_INFO: `/v3/users/1254388a078440299873aca35bcc973c` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:29.067554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e1226-a163-4af5-ac01-6c0d1a0d19ec admin admin] RBAC: Authorizing `identity:get_user(user_id=1254388a078440299873aca35bcc973c)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:29.069613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e1226-a163-4af5-ac01-6c0d1a0d19ec admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:29.071180 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 497/992] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:29 2021] GET /identity/v3/users/1254388a078440299873aca35bcc973c => generated 285 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:29.077076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb62ed-64d0-4146-835c-4a9a4d8e2d25 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:29.086734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fb62ed-64d0-4146-835c-4a9a4d8e2d25 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:29.091223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b297d-a1ef-432c-9fe2-a9a2a5a8cfbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:29.092015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b297d-a1ef-432c-9fe2-a9a2a5a8cfbd admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:29.092288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b297d-a1ef-432c-9fe2-a9a2a5a8cfbd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:29.092555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b297d-a1ef-432c-9fe2-a9a2a5a8cfbd admin admin] PATH_INFO: `/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:29.094318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b297d-a1ef-432c-9fe2-a9a2a5a8cfbd admin admin] RBAC: Authorizing `identity:get_project(project_id=f23eaa5ee4644267a1ca4bdd702bf2e1)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:29.096292 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b297d-a1ef-432c-9fe2-a9a2a5a8cfbd admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:29.098060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 496/993] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:01:29 2021] GET /identity/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:29.103930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e1226-a163-4af5-ac01-6c0d1a0d19ec admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:29.112945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e1226-a163-4af5-ac01-6c0d1a0d19ec admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:29.117507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc11158-0bba-4bee-a951-20217b4da60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:29.118364 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11158-0bba-4bee-a951-20217b4da60d admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:29.118636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11158-0bba-4bee-a951-20217b4da60d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:29.118903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc11158-0bba-4bee-a951-20217b4da60d admin admin] PATH_INFO: `/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1/users/1254388a078440299873aca35bcc973c/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:29.120796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc11158-0bba-4bee-a951-20217b4da60d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23eaa5ee4644267a1ca4bdd702bf2e1, user_id=1254388a078440299873aca35bcc973c, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:29.123338 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc11158-0bba-4bee-a951-20217b4da60d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:29.231491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 498/994] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:01:29 2021] PUT /identity/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1/users/1254388a078440299873aca35bcc973c/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:01:31.419767 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d156da-562b-4eb6-bf7b-aa4c74b87490 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:31.420297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d156da-562b-4eb6-bf7b-aa4c74b87490 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:31.420416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d156da-562b-4eb6-bf7b-aa4c74b87490 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:31.422495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 497/995] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:31.428877 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84babe6a-e94e-4256-8a9e-c28426a2a0be None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:31.429340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84babe6a-e94e-4256-8a9e-c28426a2a0be None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:31.429430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84babe6a-e94e-4256-8a9e-c28426a2a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:31.447544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-84babe6a-e94e-4256-8a9e-c28426a2a0be None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:31.448725 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-84babe6a-e94e-4256-8a9e-c28426a2a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:31.504827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 499/996] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:31.530410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d156da-562b-4eb6-bf7b-aa4c74b87490 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:31.542462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d156da-562b-4eb6-bf7b-aa4c74b87490 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:31.547054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a76de5-beb1-45eb-9bef-72a572dfa7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:31.547824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a76de5-beb1-45eb-9bef-72a572dfa7ee admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:31.548101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a76de5-beb1-45eb-9bef-72a572dfa7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:31.548372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a76de5-beb1-45eb-9bef-72a572dfa7ee admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:31.558709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a76de5-beb1-45eb-9bef-72a572dfa7ee admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:31.566239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-a4a76de5-beb1-45eb-9bef-72a572dfa7ee admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:01:31.567410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 498/997] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:01:31 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:31.574300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84babe6a-e94e-4256-8a9e-c28426a2a0be None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:31.584087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84babe6a-e94e-4256-8a9e-c28426a2a0be None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:31.588648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1411-9890-49a6-8a68-97595bcfb052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:31.589296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1411-9890-49a6-8a68-97595bcfb052 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:31.589574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1411-9890-49a6-8a68-97595bcfb052 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:31.589844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b1411-9890-49a6-8a68-97595bcfb052 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:31.590643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b1411-9890-49a6-8a68-97595bcfb052 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:31.590945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b1411-9890-49a6-8a68-97595bcfb052 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:31.592502 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b1411-9890-49a6-8a68-97595bcfb052 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:31.601971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 500/998] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:01:31 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:31.608446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a76de5-beb1-45eb-9bef-72a572dfa7ee admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:31.618816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a76de5-beb1-45eb-9bef-72a572dfa7ee admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:31.623377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c8a6d-bb41-43b8-95d8-b233b932ef77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:31.624220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c8a6d-bb41-43b8-95d8-b233b932ef77 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:31.625019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c8a6d-bb41-43b8-95d8-b233b932ef77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:31.625827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c8a6d-bb41-43b8-95d8-b233b932ef77 admin admin] PATH_INFO: `/v3/users/1254388a078440299873aca35bcc973c` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:31.627257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c8a6d-bb41-43b8-95d8-b233b932ef77 admin admin] RBAC: Authorizing `identity:get_user(user_id=1254388a078440299873aca35bcc973c)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:31.629375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c8a6d-bb41-43b8-95d8-b233b932ef77 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:31.630976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 499/999] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:31 2021] GET /identity/v3/users/1254388a078440299873aca35bcc973c => generated 285 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:31.638534 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1411-9890-49a6-8a68-97595bcfb052 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:31.649113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b1411-9890-49a6-8a68-97595bcfb052 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:31.653786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec6756-bb80-4371-bedd-ec276b135ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:31.654569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec6756-bb80-4371-bedd-ec276b135ada admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:31.654846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec6756-bb80-4371-bedd-ec276b135ada admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:31.655177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ec6756-bb80-4371-bedd-ec276b135ada admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:31.666471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec6756-bb80-4371-bedd-ec276b135ada admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:31.668187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ec6756-bb80-4371-bedd-ec276b135ada admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:31.680852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 501/1000] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:31 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:31.688650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c8a6d-bb41-43b8-95d8-b233b932ef77 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:31.699777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c8a6d-bb41-43b8-95d8-b233b932ef77 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:31.705137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c593ed7-6efd-4843-b960-b9536a5487d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:31.705973 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c593ed7-6efd-4843-b960-b9536a5487d3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:31.706276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c593ed7-6efd-4843-b960-b9536a5487d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:31.706546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c593ed7-6efd-4843-b960-b9536a5487d3 admin admin] PATH_INFO: `/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:31.707703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c593ed7-6efd-4843-b960-b9536a5487d3 admin admin] RBAC: Authorizing `identity:get_project(project_id=f23eaa5ee4644267a1ca4bdd702bf2e1)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:31.709728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c593ed7-6efd-4843-b960-b9536a5487d3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:31.711391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 500/1001] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:01:31 2021] GET /identity/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1 => generated 311 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:31.718098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec6756-bb80-4371-bedd-ec276b135ada admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:31.727257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ec6756-bb80-4371-bedd-ec276b135ada admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:31.732344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3900adb-17c8-4b6c-a34e-31dece13edf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:31.732983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3900adb-17c8-4b6c-a34e-31dece13edf7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:31.733283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3900adb-17c8-4b6c-a34e-31dece13edf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:31.733554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3900adb-17c8-4b6c-a34e-31dece13edf7 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:31.734760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3900adb-17c8-4b6c-a34e-31dece13edf7 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1, user.id=1254388a078440299873aca35bcc973c) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:31.735076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3900adb-17c8-4b6c-a34e-31dece13edf7 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:31.736890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3900adb-17c8-4b6c-a34e-31dece13edf7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:31.742833 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 502/1002] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:31 2021] GET /identity/v3/role_assignments?user.id=1254388a078440299873aca35bcc973c&scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:34.023663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf694a8-ddda-459e-92e5-5f2dc1f6caf8 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:34.024162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf694a8-ddda-459e-92e5-5f2dc1f6caf8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:34.024270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf694a8-ddda-459e-92e5-5f2dc1f6caf8 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:34.026117 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 501/1003] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:34.032364 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a13a0-3306-4ed4-9165-5fb02beb1121 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:34.032795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a13a0-3306-4ed4-9165-5fb02beb1121 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:34.032990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a13a0-3306-4ed4-9165-5fb02beb1121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:34.050649 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-5c2a13a0-3306-4ed4-9165-5fb02beb1121 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:34.051815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5c2a13a0-3306-4ed4-9165-5fb02beb1121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:34.059348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 503/1004] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:34.086322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf694a8-ddda-459e-92e5-5f2dc1f6caf8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:34.098231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf694a8-ddda-459e-92e5-5f2dc1f6caf8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:34.102449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47641a37-bbf3-4173-8908-05c0fc4c6061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:34.103202 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47641a37-bbf3-4173-8908-05c0fc4c6061 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:34.103474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47641a37-bbf3-4173-8908-05c0fc4c6061 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:34.103738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47641a37-bbf3-4173-8908-05c0fc4c6061 admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:34.104874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47641a37-bbf3-4173-8908-05c0fc4c6061 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:34.106578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47641a37-bbf3-4173-8908-05c0fc4c6061 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:34.108093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 502/1005] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:34 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:34.114682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a13a0-3306-4ed4-9165-5fb02beb1121 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:34.123340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2a13a0-3306-4ed4-9165-5fb02beb1121 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:34.128363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7575d3ae-6de3-4e62-a700-9c3af472f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:34.129001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d3ae-6de3-4e62-a700-9c3af472f5de admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:34.129277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d3ae-6de3-4e62-a700-9c3af472f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:34.129548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7575d3ae-6de3-4e62-a700-9c3af472f5de admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:34.130289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d3ae-6de3-4e62-a700-9c3af472f5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:34.132156 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7575d3ae-6de3-4e62-a700-9c3af472f5de admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:34.448250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 504/1006] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:01:34 2021] POST /identity/v3/users => generated 286 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:01:36.735740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e118a-961b-43fd-99b4-af579d4b1765 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:36.736306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e118a-961b-43fd-99b4-af579d4b1765 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:36.736306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708e118a-961b-43fd-99b4-af579d4b1765 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:36.738045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 503/1007] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:36 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:36.744326 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e78ed-ad10-401d-8ced-a0bdc45234b2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:36.744720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e78ed-ad10-401d-8ced-a0bdc45234b2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:36.744871 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871e78ed-ad10-401d-8ced-a0bdc45234b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:36.762587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-871e78ed-ad10-401d-8ced-a0bdc45234b2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:36.763752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-871e78ed-ad10-401d-8ced-a0bdc45234b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:36.772372 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 505/1008] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:36.802080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e118a-961b-43fd-99b4-af579d4b1765 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:36.816248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708e118a-961b-43fd-99b4-af579d4b1765 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:36.820481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f4828-10eb-4569-8a8d-c6bb31ddad42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:36.821302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f4828-10eb-4569-8a8d-c6bb31ddad42 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:36.821576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f4828-10eb-4569-8a8d-c6bb31ddad42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:36.821842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8f4828-10eb-4569-8a8d-c6bb31ddad42 admin admin] PATH_INFO: `/v3/roles/3e47746460b74dbb90c678ac5b65a01a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:36.823313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f4828-10eb-4569-8a8d-c6bb31ddad42 admin admin] RBAC: Authorizing `identity:get_role(role_id=3e47746460b74dbb90c678ac5b65a01a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:36.824317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-aa8f4828-10eb-4569-8a8d-c6bb31ddad42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:01:36.824317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:01:36.824317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:01:36.825168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8f4828-10eb-4569-8a8d-c6bb31ddad42 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:36.826496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 504/1009] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:36 2021] GET /identity/v3/roles/3e47746460b74dbb90c678ac5b65a01a => generated 223 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:36.834082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e78ed-ad10-401d-8ced-a0bdc45234b2 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:36.842792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871e78ed-ad10-401d-8ced-a0bdc45234b2 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:36.847192 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9d363-0c25-4ca2-97bd-ad4857d97aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:36.848024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d363-0c25-4ca2-97bd-ad4857d97aaa admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:36.848297 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d363-0c25-4ca2-97bd-ad4857d97aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:36.848566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9d363-0c25-4ca2-97bd-ad4857d97aaa admin admin] PATH_INFO: `/v3/users/6f3f5644aa15436691683ff0b14a5b06` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:36.861437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9d363-0c25-4ca2-97bd-ad4857d97aaa admin admin] RBAC: Authorizing `identity:get_user(user_id=6f3f5644aa15436691683ff0b14a5b06)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:36.863573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9d363-0c25-4ca2-97bd-ad4857d97aaa admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:36.865156 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 506/1010] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:36 2021] GET /identity/v3/users/6f3f5644aa15436691683ff0b14a5b06 => generated 286 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:36.871316 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f4828-10eb-4569-8a8d-c6bb31ddad42 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:36.881144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8f4828-10eb-4569-8a8d-c6bb31ddad42 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:36.885423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4b54-0a32-450f-bd0e-d348974236ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:36.886046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4b54-0a32-450f-bd0e-d348974236ee admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:36.886329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4b54-0a32-450f-bd0e-d348974236ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:36.886593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e4b54-0a32-450f-bd0e-d348974236ee admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:36.894512 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e4b54-0a32-450f-bd0e-d348974236ee admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:36.896454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e4b54-0a32-450f-bd0e-d348974236ee admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:36.904809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 505/1011] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:36 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:36.910966 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9d363-0c25-4ca2-97bd-ad4857d97aaa admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:36.920070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9d363-0c25-4ca2-97bd-ad4857d97aaa admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:36.924487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472eeea-41f0-463b-b714-c5390df22f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:36.925301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472eeea-41f0-463b-b714-c5390df22f5e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:36.925575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472eeea-41f0-463b-b714-c5390df22f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:36.925840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472eeea-41f0-463b-b714-c5390df22f5e admin admin] PATH_INFO: `/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:36.927033 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472eeea-41f0-463b-b714-c5390df22f5e admin admin] RBAC: Authorizing `identity:get_project(project_id=f23eaa5ee4644267a1ca4bdd702bf2e1)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:36.928995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472eeea-41f0-463b-b714-c5390df22f5e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:36.930617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 507/1012] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:01:36 2021] GET /identity/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:36.937232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4b54-0a32-450f-bd0e-d348974236ee admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:36.945489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e4b54-0a32-450f-bd0e-d348974236ee admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:36.949807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2871f55-54b6-4af2-9246-b963e0996066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:36.950452 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2871f55-54b6-4af2-9246-b963e0996066 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:36.950728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2871f55-54b6-4af2-9246-b963e0996066 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:36.950994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2871f55-54b6-4af2-9246-b963e0996066 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:36.951801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2871f55-54b6-4af2-9246-b963e0996066 admin admin] RBAC: Adding query filter params (role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1, user.id=6f3f5644aa15436691683ff0b14a5b06) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:36.952101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2871f55-54b6-4af2-9246-b963e0996066 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:36.954694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2871f55-54b6-4af2-9246-b963e0996066 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:36.959734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 506/1013] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:36 2021] GET /identity/v3/role_assignments?user.id=6f3f5644aa15436691683ff0b14a5b06&scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:39.212953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5eb8-fb5d-4b44-a1a3-2bfdbdbbff2a None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:39.213480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5eb8-fb5d-4b44-a1a3-2bfdbdbbff2a None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:39.213480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a5eb8-fb5d-4b44-a1a3-2bfdbdbbff2a None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:39.215290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 508/1014] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:39.222127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36f8d7-355f-4277-9c5c-16494b91a8f9 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:39.222558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36f8d7-355f-4277-9c5c-16494b91a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:39.222676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d36f8d7-355f-4277-9c5c-16494b91a8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:39.240355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8d36f8d7-355f-4277-9c5c-16494b91a8f9 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:39.241517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8d36f8d7-355f-4277-9c5c-16494b91a8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:39.248904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 507/1015] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:39.273717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5eb8-fb5d-4b44-a1a3-2bfdbdbbff2a None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:39.285935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a5eb8-fb5d-4b44-a1a3-2bfdbdbbff2a None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:39.290202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7909e-1201-43ef-894d-1da193ebb5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:39.291021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7909e-1201-43ef-894d-1da193ebb5a6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:39.291293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7909e-1201-43ef-894d-1da193ebb5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:39.291559 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f7909e-1201-43ef-894d-1da193ebb5a6 admin admin] PATH_INFO: `/v3/roles/3e47746460b74dbb90c678ac5b65a01a` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:39.292992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7909e-1201-43ef-894d-1da193ebb5a6 admin admin] RBAC: Authorizing `identity:get_role(role_id=3e47746460b74dbb90c678ac5b65a01a)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:39.293980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-53f7909e-1201-43ef-894d-1da193ebb5a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:get_role failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:01:39.293980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:01:39.293980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:01:39.294855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f7909e-1201-43ef-894d-1da193ebb5a6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:39.296230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 509/1016] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:39 2021] GET /identity/v3/roles/3e47746460b74dbb90c678ac5b65a01a => generated 223 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:39.302267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36f8d7-355f-4277-9c5c-16494b91a8f9 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:39.310855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d36f8d7-355f-4277-9c5c-16494b91a8f9 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:39.315431 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae413b7-dfc8-4d57-a0cb-dca261cc4e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:39.316267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae413b7-dfc8-4d57-a0cb-dca261cc4e2e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:39.316546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae413b7-dfc8-4d57-a0cb-dca261cc4e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:39.316817 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae413b7-dfc8-4d57-a0cb-dca261cc4e2e admin admin] PATH_INFO: `/v3/users/6f3f5644aa15436691683ff0b14a5b06` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:39.317993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae413b7-dfc8-4d57-a0cb-dca261cc4e2e admin admin] RBAC: Authorizing `identity:get_user(user_id=6f3f5644aa15436691683ff0b14a5b06)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:39.320128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae413b7-dfc8-4d57-a0cb-dca261cc4e2e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:39.321674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 508/1017] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:39 2021] GET /identity/v3/users/6f3f5644aa15436691683ff0b14a5b06 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:39.328149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7909e-1201-43ef-894d-1da193ebb5a6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:39.337199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f7909e-1201-43ef-894d-1da193ebb5a6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:39.341524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59596b20-2449-480e-b377-45aceeb5d80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:39.342351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596b20-2449-480e-b377-45aceeb5d80c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:39.342625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596b20-2449-480e-b377-45aceeb5d80c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:39.343508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59596b20-2449-480e-b377-45aceeb5d80c admin admin] PATH_INFO: `/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:39.344643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596b20-2449-480e-b377-45aceeb5d80c admin admin] RBAC: Authorizing `identity:get_project(project_id=f23eaa5ee4644267a1ca4bdd702bf2e1)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:39.346632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59596b20-2449-480e-b377-45aceeb5d80c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:39.348215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 510/1018] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:01:39 2021] GET /identity/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:39.354319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae413b7-dfc8-4d57-a0cb-dca261cc4e2e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:39.363552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae413b7-dfc8-4d57-a0cb-dca261cc4e2e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:39.367872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9504404f-6174-4d10-bf0b-5a5934323392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:39.368706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504404f-6174-4d10-bf0b-5a5934323392 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:39.368984 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504404f-6174-4d10-bf0b-5a5934323392 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:39.369253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9504404f-6174-4d10-bf0b-5a5934323392 admin admin] PATH_INFO: `/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1/users/6f3f5644aa15436691683ff0b14a5b06/roles/3e47746460b74dbb90c678ac5b65a01a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:39.371448 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504404f-6174-4d10-bf0b-5a5934323392 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f23eaa5ee4644267a1ca4bdd702bf2e1, user_id=6f3f5644aa15436691683ff0b14a5b06, role_id=3e47746460b74dbb90c678ac5b65a01a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:39.373987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9504404f-6174-4d10-bf0b-5a5934323392 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:39.500161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 509/1019] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:01:39 2021] PUT /identity/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1/users/6f3f5644aa15436691683ff0b14a5b06/roles/3e47746460b74dbb90c678ac5b65a01a => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:01:41.715625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fb7a5-f443-44ca-8f9a-aa878dfd681e None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:41.716193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fb7a5-f443-44ca-8f9a-aa878dfd681e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:41.716193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957fb7a5-f443-44ca-8f9a-aa878dfd681e None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:41.717982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 511/1020] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:41 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:41.724541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0994701-b39f-4db3-b4b4-0e2504749530 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:41.724974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0994701-b39f-4db3-b4b4-0e2504749530 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:41.725067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0994701-b39f-4db3-b4b4-0e2504749530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:41.742012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e0994701-b39f-4db3-b4b4-0e2504749530 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:41.743195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e0994701-b39f-4db3-b4b4-0e2504749530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:41.796964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 510/1021] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:41 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:41.821240 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fb7a5-f443-44ca-8f9a-aa878dfd681e None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:41.833563 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957fb7a5-f443-44ca-8f9a-aa878dfd681e None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:41.837787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aecb4d-85a3-4425-84a4-3ebb619a99f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:41.838634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aecb4d-85a3-4425-84a4-3ebb619a99f7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:41.838908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aecb4d-85a3-4425-84a4-3ebb619a99f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:41.839178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aecb4d-85a3-4425-84a4-3ebb619a99f7 admin admin] PATH_INFO: `/v3/roles/3e47746460b74dbb90c678ac5b65a01a` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:41.840794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aecb4d-85a3-4425-84a4-3ebb619a99f7 admin admin] RBAC: Authorizing `identity:get_role(role_id=3e47746460b74dbb90c678ac5b65a01a)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:41.842388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aecb4d-85a3-4425-84a4-3ebb619a99f7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:41.844410 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 512/1022] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:41 2021] GET /identity/v3/roles/3e47746460b74dbb90c678ac5b65a01a => generated 223 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:41.850437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0994701-b39f-4db3-b4b4-0e2504749530 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:41.859177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0994701-b39f-4db3-b4b4-0e2504749530 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:41.863518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c28b-cb3b-4338-b348-4df2f406a1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:41.864353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c28b-cb3b-4338-b348-4df2f406a1db admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:41.864625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c28b-cb3b-4338-b348-4df2f406a1db admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:41.864889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9193c28b-cb3b-4338-b348-4df2f406a1db admin admin] PATH_INFO: `/v3/users/6f3f5644aa15436691683ff0b14a5b06` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:41.866074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193c28b-cb3b-4338-b348-4df2f406a1db admin admin] RBAC: Authorizing `identity:get_user(user_id=6f3f5644aa15436691683ff0b14a5b06)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:41.868170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9193c28b-cb3b-4338-b348-4df2f406a1db admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:41.869690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 511/1023] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:41 2021] GET /identity/v3/users/6f3f5644aa15436691683ff0b14a5b06 => generated 286 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:41.876209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aecb4d-85a3-4425-84a4-3ebb619a99f7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:41.885337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aecb4d-85a3-4425-84a4-3ebb619a99f7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:41.889787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ffed5-40d2-424f-8c26-166c3c0c00c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:41.890529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ffed5-40d2-424f-8c26-166c3c0c00c5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:41.890801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ffed5-40d2-424f-8c26-166c3c0c00c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:41.891068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ffed5-40d2-424f-8c26-166c3c0c00c5 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:41.898818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ffed5-40d2-424f-8c26-166c3c0c00c5 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:41.900483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ffed5-40d2-424f-8c26-166c3c0c00c5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:41.911489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 513/1024] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:41 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:41.917714 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c28b-cb3b-4338-b348-4df2f406a1db admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:41.927698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9193c28b-cb3b-4338-b348-4df2f406a1db admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:41.933144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1870471-26c2-416c-bc69-3c1ddd67ca34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:41.933955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1870471-26c2-416c-bc69-3c1ddd67ca34 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:41.934256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1870471-26c2-416c-bc69-3c1ddd67ca34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:41.934524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1870471-26c2-416c-bc69-3c1ddd67ca34 admin admin] PATH_INFO: `/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:41.935664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1870471-26c2-416c-bc69-3c1ddd67ca34 admin admin] RBAC: Authorizing `identity:get_project(project_id=f23eaa5ee4644267a1ca4bdd702bf2e1)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:41.937672 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1870471-26c2-416c-bc69-3c1ddd67ca34 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:41.939282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 512/1025] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:01:41 2021] GET /identity/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:41.945787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ffed5-40d2-424f-8c26-166c3c0c00c5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:41.954868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ffed5-40d2-424f-8c26-166c3c0c00c5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:41.959369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a2901-aaf6-44eb-bd4d-3a18d5baf8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:41.959994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a2901-aaf6-44eb-bd4d-3a18d5baf8fc admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:41.960272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a2901-aaf6-44eb-bd4d-3a18d5baf8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:41.960541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a2901-aaf6-44eb-bd4d-3a18d5baf8fc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:41.961370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a2901-aaf6-44eb-bd4d-3a18d5baf8fc admin admin] RBAC: Adding query filter params (role.id=3e47746460b74dbb90c678ac5b65a01a, scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1, user.id=6f3f5644aa15436691683ff0b14a5b06) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:41.961689 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a2901-aaf6-44eb-bd4d-3a18d5baf8fc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:41.963510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a2901-aaf6-44eb-bd4d-3a18d5baf8fc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:41.969949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 514/1026] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:41 2021] GET /identity/v3/role_assignments?user.id=6f3f5644aa15436691683ff0b14a5b06&scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1&role.id=3e47746460b74dbb90c678ac5b65a01a => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:44.231519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686e07-46df-497a-9c97-8ccc9dfa274b None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:44.232074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686e07-46df-497a-9c97-8ccc9dfa274b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:44.232074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686e07-46df-497a-9c97-8ccc9dfa274b None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:44.234548 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 513/1027] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:44.240444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c89c6b-fca4-42fa-8b69-b708bb97b143 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:44.240830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c89c6b-fca4-42fa-8b69-b708bb97b143 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:44.240992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c89c6b-fca4-42fa-8b69-b708bb97b143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:44.258226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e3c89c6b-fca4-42fa-8b69-b708bb97b143 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:44.259326 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e3c89c6b-fca4-42fa-8b69-b708bb97b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:44.266918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 515/1028] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:44 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:44.291454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e686e07-46df-497a-9c97-8ccc9dfa274b None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:44.303952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e686e07-46df-497a-9c97-8ccc9dfa274b None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:44.308235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3229db75-200f-4a63-8b88-1310f6df570a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:44.308990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229db75-200f-4a63-8b88-1310f6df570a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:44.309269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229db75-200f-4a63-8b88-1310f6df570a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:44.309540 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3229db75-200f-4a63-8b88-1310f6df570a admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:44.310704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229db75-200f-4a63-8b88-1310f6df570a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:44.312415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3229db75-200f-4a63-8b88-1310f6df570a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:44.313955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 514/1029] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:44 2021] GET /identity/v3/domains/default => generated 199 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:44.319827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c89c6b-fca4-42fa-8b69-b708bb97b143 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:44.328351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c89c6b-fca4-42fa-8b69-b708bb97b143 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:44.332768 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94899362-30c8-4d91-a0ca-4dd4ad35582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:44.333394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899362-30c8-4d91-a0ca-4dd4ad35582a admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:44.333672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899362-30c8-4d91-a0ca-4dd4ad35582a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:44.333941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94899362-30c8-4d91-a0ca-4dd4ad35582a admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:44.334677 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94899362-30c8-4d91-a0ca-4dd4ad35582a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:44.336609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94899362-30c8-4d91-a0ca-4dd4ad35582a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:44.426532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 516/1030] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:01:44 2021] POST /identity/v3/projects => generated 311 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:01:46.695527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c83e7-759e-4a13-a692-a80a566072fa None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:46.696056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c83e7-759e-4a13-a692-a80a566072fa None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:46.696056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c83e7-759e-4a13-a692-a80a566072fa None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:46.697807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 515/1031] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:46.703729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be80614-4acb-46f8-9c7d-d71957fe780d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:46.704155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be80614-4acb-46f8-9c7d-d71957fe780d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:46.704250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be80614-4acb-46f8-9c7d-d71957fe780d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:46.721966 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-3be80614-4acb-46f8-9c7d-d71957fe780d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:46.723170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-3be80614-4acb-46f8-9c7d-d71957fe780d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:46.777336 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 517/1032] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:46 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:46.803032 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c83e7-759e-4a13-a692-a80a566072fa None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:46.815025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c83e7-759e-4a13-a692-a80a566072fa None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:46.819225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5843703b-95d4-43f9-a27d-46e3f5b68f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:46.819986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843703b-95d4-43f9-a27d-46e3f5b68f4c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:46.820264 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843703b-95d4-43f9-a27d-46e3f5b68f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:46.820536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5843703b-95d4-43f9-a27d-46e3f5b68f4c admin admin] PATH_INFO: `/v3/domains/default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:46.821685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843703b-95d4-43f9-a27d-46e3f5b68f4c admin admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:46.823371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5843703b-95d4-43f9-a27d-46e3f5b68f4c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:46.824898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 516/1033] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:01:46 2021] GET /identity/v3/domains/default => generated 199 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:46.831601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be80614-4acb-46f8-9c7d-d71957fe780d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:46.841021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be80614-4acb-46f8-9c7d-d71957fe780d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:46.845993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37385f-a1d2-4d8c-8b4a-ccbc9f350388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:46.846655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37385f-a1d2-4d8c-8b4a-ccbc9f350388 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:46.846926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37385f-a1d2-4d8c-8b4a-ccbc9f350388 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:46.847189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37385f-a1d2-4d8c-8b4a-ccbc9f350388 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:46.847889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37385f-a1d2-4d8c-8b4a-ccbc9f350388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:46.849751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37385f-a1d2-4d8c-8b4a-ccbc9f350388 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:46.960035 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 518/1034] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:01:46 2021] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:01:49.247558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681dbf6-6723-4473-ac25-5b2de144f573 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:49.248084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681dbf6-6723-4473-ac25-5b2de144f573 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:49.248084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7681dbf6-6723-4473-ac25-5b2de144f573 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:49.250058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 517/1035] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:49 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:49.255856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3a4ed-9780-4dee-99f9-6ba346f4b157 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:49.256235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3a4ed-9780-4dee-99f9-6ba346f4b157 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:49.256394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3a4ed-9780-4dee-99f9-6ba346f4b157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:49.275199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-97b3a4ed-9780-4dee-99f9-6ba346f4b157 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:49.276381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-97b3a4ed-9780-4dee-99f9-6ba346f4b157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:49.284567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 519/1036] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:49 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:49.308767 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681dbf6-6723-4473-ac25-5b2de144f573 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:49.320612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7681dbf6-6723-4473-ac25-5b2de144f573 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:49.324788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dcc6d-364b-4ff6-85e0-24f927b2a5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:49.325536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dcc6d-364b-4ff6-85e0-24f927b2a5ec admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:49.325808 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dcc6d-364b-4ff6-85e0-24f927b2a5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:49.326104 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dcc6d-364b-4ff6-85e0-24f927b2a5ec admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:49.336349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dcc6d-364b-4ff6-85e0-24f927b2a5ec admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:49.343706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-947dcc6d-364b-4ff6-85e0-24f927b2a5ec admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:01:49.344799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 518/1037] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:01:49 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:49.351061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3a4ed-9780-4dee-99f9-6ba346f4b157 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:49.360062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3a4ed-9780-4dee-99f9-6ba346f4b157 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:49.364477 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dac5e-d935-4e5b-9de7-016b6b539aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:49.365111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dac5e-d935-4e5b-9de7-016b6b539aaf admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:49.365386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dac5e-d935-4e5b-9de7-016b6b539aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:49.365652 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20dac5e-d935-4e5b-9de7-016b6b539aaf admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:49.366500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dac5e-d935-4e5b-9de7-016b6b539aaf admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:49.366801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dac5e-d935-4e5b-9de7-016b6b539aaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:49.368372 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20dac5e-d935-4e5b-9de7-016b6b539aaf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:49.376861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 520/1038] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:01:49 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:49.382823 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dcc6d-364b-4ff6-85e0-24f927b2a5ec admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:49.392953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dcc6d-364b-4ff6-85e0-24f927b2a5ec admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:49.397576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445983fa-b7d6-48f3-ad7f-909968370ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:49.398411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445983fa-b7d6-48f3-ad7f-909968370ecd admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:49.398684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445983fa-b7d6-48f3-ad7f-909968370ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:49.398948 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445983fa-b7d6-48f3-ad7f-909968370ecd admin admin] PATH_INFO: `/v3/users/57039dc4b1ff4cc3b9e5655fa295a287` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:49.411538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445983fa-b7d6-48f3-ad7f-909968370ecd admin admin] RBAC: Authorizing `identity:get_user(user_id=57039dc4b1ff4cc3b9e5655fa295a287)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:49.413624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445983fa-b7d6-48f3-ad7f-909968370ecd admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:49.415209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 519/1039] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:49 2021] GET /identity/v3/users/57039dc4b1ff4cc3b9e5655fa295a287 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:49.421535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dac5e-d935-4e5b-9de7-016b6b539aaf admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:49.430808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20dac5e-d935-4e5b-9de7-016b6b539aaf admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:49.435208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f59c93-175e-4a4d-9ac7-de3ed687666c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:49.435824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f59c93-175e-4a4d-9ac7-de3ed687666c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:49.436597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f59c93-175e-4a4d-9ac7-de3ed687666c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:49.437104 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f59c93-175e-4a4d-9ac7-de3ed687666c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:49.444606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f59c93-175e-4a4d-9ac7-de3ed687666c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:49.446330 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f59c93-175e-4a4d-9ac7-de3ed687666c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:49.455842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 521/1040] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:49 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:49.461758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445983fa-b7d6-48f3-ad7f-909968370ecd admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:49.470956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445983fa-b7d6-48f3-ad7f-909968370ecd admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:49.475242 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62185da1-f096-40fa-ab32-1af42ce0682f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:49.476041 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62185da1-f096-40fa-ab32-1af42ce0682f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:49.476332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62185da1-f096-40fa-ab32-1af42ce0682f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:49.476597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62185da1-f096-40fa-ab32-1af42ce0682f admin admin] PATH_INFO: `/v3/projects/4f57dca270564e15b40b0a58b6284c77` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:49.477757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62185da1-f096-40fa-ab32-1af42ce0682f admin admin] RBAC: Authorizing `identity:get_project(project_id=4f57dca270564e15b40b0a58b6284c77)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:49.479737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62185da1-f096-40fa-ab32-1af42ce0682f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:49.481306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 520/1041] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:01:49 2021] GET /identity/v3/projects/4f57dca270564e15b40b0a58b6284c77 => generated 311 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:49.487921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f59c93-175e-4a4d-9ac7-de3ed687666c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:49.496299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f59c93-175e-4a4d-9ac7-de3ed687666c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:49.501383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca3cd00-403c-43e9-a4a8-4c890fc6e699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:49.501922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3cd00-403c-43e9-a4a8-4c890fc6e699 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:49.502239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3cd00-403c-43e9-a4a8-4c890fc6e699 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:49.502511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca3cd00-403c-43e9-a4a8-4c890fc6e699 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:49.503333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3cd00-403c-43e9-a4a8-4c890fc6e699 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=4f57dca270564e15b40b0a58b6284c77, user.id=57039dc4b1ff4cc3b9e5655fa295a287) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:49.503638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3cd00-403c-43e9-a4a8-4c890fc6e699 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:49.505396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca3cd00-403c-43e9-a4a8-4c890fc6e699 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:49.510585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 522/1042] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:49 2021] GET /identity/v3/role_assignments?user.id=57039dc4b1ff4cc3b9e5655fa295a287&scope.project.id=4f57dca270564e15b40b0a58b6284c77&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:01:51.725413 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f89117-0d14-4f0d-adc6-75c7f42f7ed8 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:51.725963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f89117-0d14-4f0d-adc6-75c7f42f7ed8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:51.725963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f89117-0d14-4f0d-adc6-75c7f42f7ed8 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:51.727712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 521/1043] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:51 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:51.733850 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecfd48-8e6e-49ed-a524-eda9563158b3 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:51.734280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecfd48-8e6e-49ed-a524-eda9563158b3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:51.734484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ecfd48-8e6e-49ed-a524-eda9563158b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:51.752174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-88ecfd48-8e6e-49ed-a524-eda9563158b3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:51.753336 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-88ecfd48-8e6e-49ed-a524-eda9563158b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:51.760785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 523/1044] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:51 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:01:51.784254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f89117-0d14-4f0d-adc6-75c7f42f7ed8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:51.796348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f89117-0d14-4f0d-adc6-75c7f42f7ed8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:51.800572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a49dd-cb2a-4de7-a9e9-3e13ecb2fefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:51.801319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a49dd-cb2a-4de7-a9e9-3e13ecb2fefe admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:51.801590 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a49dd-cb2a-4de7-a9e9-3e13ecb2fefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:51.801856 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a49dd-cb2a-4de7-a9e9-3e13ecb2fefe admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:51.811546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a49dd-cb2a-4de7-a9e9-3e13ecb2fefe admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:51.818175 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-4c4a49dd-cb2a-4de7-a9e9-3e13ecb2fefe admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:01:51.819270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 522/1045] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:01:51 2021] GET /identity/v3/roles/admin => generated 83 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:51.825627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecfd48-8e6e-49ed-a524-eda9563158b3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:51.834645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ecfd48-8e6e-49ed-a524-eda9563158b3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:51.839086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77bdc6-e713-4e68-96db-2cb161e2f5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:51.839723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77bdc6-e713-4e68-96db-2cb161e2f5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:51.839999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77bdc6-e713-4e68-96db-2cb161e2f5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:51.840269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77bdc6-e713-4e68-96db-2cb161e2f5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:51.841014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77bdc6-e713-4e68-96db-2cb161e2f5c4 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:51.841315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77bdc6-e713-4e68-96db-2cb161e2f5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:51.843763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77bdc6-e713-4e68-96db-2cb161e2f5c4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:51.852011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 524/1046] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:01:51 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:51.858443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a49dd-cb2a-4de7-a9e9-3e13ecb2fefe admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:51.868336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a49dd-cb2a-4de7-a9e9-3e13ecb2fefe admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:51.872673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f53405-b6b5-4dff-b72d-6ad2f2f1a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:51.873559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f53405-b6b5-4dff-b72d-6ad2f2f1a3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:51.873999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f53405-b6b5-4dff-b72d-6ad2f2f1a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:51.874301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f53405-b6b5-4dff-b72d-6ad2f2f1a3e4 admin admin] PATH_INFO: `/v3/users/57039dc4b1ff4cc3b9e5655fa295a287` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:51.875475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f53405-b6b5-4dff-b72d-6ad2f2f1a3e4 admin admin] RBAC: Authorizing `identity:get_user(user_id=57039dc4b1ff4cc3b9e5655fa295a287)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:51.877542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f53405-b6b5-4dff-b72d-6ad2f2f1a3e4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:51.879131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 523/1047] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:51 2021] GET /identity/v3/users/57039dc4b1ff4cc3b9e5655fa295a287 => generated 286 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:51.885027 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77bdc6-e713-4e68-96db-2cb161e2f5c4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:51.894200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77bdc6-e713-4e68-96db-2cb161e2f5c4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:51.898844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83fd04-4ac3-4e30-ae84-afb9b8567077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:51.899651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83fd04-4ac3-4e30-ae84-afb9b8567077 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:51.899929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83fd04-4ac3-4e30-ae84-afb9b8567077 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:51.900201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83fd04-4ac3-4e30-ae84-afb9b8567077 admin admin] PATH_INFO: `/v3/projects/4f57dca270564e15b40b0a58b6284c77` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:51.901349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83fd04-4ac3-4e30-ae84-afb9b8567077 admin admin] RBAC: Authorizing `identity:get_project(project_id=4f57dca270564e15b40b0a58b6284c77)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:51.903377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83fd04-4ac3-4e30-ae84-afb9b8567077 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:51.905715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 525/1048] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:01:51 2021] GET /identity/v3/projects/4f57dca270564e15b40b0a58b6284c77 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:51.911468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f53405-b6b5-4dff-b72d-6ad2f2f1a3e4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:51.921021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f53405-b6b5-4dff-b72d-6ad2f2f1a3e4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:51.925333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bb384f-d295-47e8-a273-04f27648ab61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:51.926181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb384f-d295-47e8-a273-04f27648ab61 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:51.926457 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb384f-d295-47e8-a273-04f27648ab61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:51.926724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bb384f-d295-47e8-a273-04f27648ab61 admin admin] PATH_INFO: `/v3/projects/4f57dca270564e15b40b0a58b6284c77/users/57039dc4b1ff4cc3b9e5655fa295a287/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:51.928606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb384f-d295-47e8-a273-04f27648ab61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f57dca270564e15b40b0a58b6284c77, user_id=57039dc4b1ff4cc3b9e5655fa295a287, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:51.931156 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bb384f-d295-47e8-a273-04f27648ab61 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:52.020375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 524/1049] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:01:51 2021] PUT /identity/v3/projects/4f57dca270564e15b40b0a58b6284c77/users/57039dc4b1ff4cc3b9e5655fa295a287/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:01:54.247979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc336-d2a5-4425-82e4-b7ca5c182190 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:54.249012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc336-d2a5-4425-82e4-b7ca5c182190 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:54.249121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfc336-d2a5-4425-82e4-b7ca5c182190 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:54.250971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 526/1050] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:54 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:54.256937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8184-312c-4cbd-97a5-586c8676e1e8 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:54.257362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8184-312c-4cbd-97a5-586c8676e1e8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:54.257490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a8184-312c-4cbd-97a5-586c8676e1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:54.276418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-745a8184-312c-4cbd-97a5-586c8676e1e8 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:54.277597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-745a8184-312c-4cbd-97a5-586c8676e1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:54.332504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 525/1051] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:54 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:54.356870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfc336-d2a5-4425-82e4-b7ca5c182190 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:54.369201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfc336-d2a5-4425-82e4-b7ca5c182190 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:54.374280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90589b84-9901-43d6-80e0-38a7bfe8945b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:54.375035 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90589b84-9901-43d6-80e0-38a7bfe8945b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:54.375309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90589b84-9901-43d6-80e0-38a7bfe8945b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:54.375576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90589b84-9901-43d6-80e0-38a7bfe8945b admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:54.385191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90589b84-9901-43d6-80e0-38a7bfe8945b admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:01:54.391972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-90589b84-9901-43d6-80e0-38a7bfe8945b admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:01:54.393081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 527/1052] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:01:54 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:01:54.399926 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a8184-312c-4cbd-97a5-586c8676e1e8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:54.408713 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a8184-312c-4cbd-97a5-586c8676e1e8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:54.413076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86d6df-6412-42d4-9f47-985ff927173f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:54.413718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86d6df-6412-42d4-9f47-985ff927173f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:54.413995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86d6df-6412-42d4-9f47-985ff927173f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:54.414294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86d6df-6412-42d4-9f47-985ff927173f admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:54.415042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86d6df-6412-42d4-9f47-985ff927173f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:54.415343 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86d6df-6412-42d4-9f47-985ff927173f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:54.416907 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86d6df-6412-42d4-9f47-985ff927173f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:54.425177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 526/1053] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:01:54 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:54.431097 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90589b84-9901-43d6-80e0-38a7bfe8945b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:54.441404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90589b84-9901-43d6-80e0-38a7bfe8945b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:54.445766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371db2c8-f2f4-4605-ab28-45e3de7523f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:54.446621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371db2c8-f2f4-4605-ab28-45e3de7523f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:54.446896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371db2c8-f2f4-4605-ab28-45e3de7523f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:54.447163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371db2c8-f2f4-4605-ab28-45e3de7523f4 admin admin] PATH_INFO: `/v3/users/57039dc4b1ff4cc3b9e5655fa295a287` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:54.448337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371db2c8-f2f4-4605-ab28-45e3de7523f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=57039dc4b1ff4cc3b9e5655fa295a287)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:54.450444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371db2c8-f2f4-4605-ab28-45e3de7523f4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:54.452217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 528/1054] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:01:54 2021] GET /identity/v3/users/57039dc4b1ff4cc3b9e5655fa295a287 => generated 286 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:54.458116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86d6df-6412-42d4-9f47-985ff927173f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:54.467545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86d6df-6412-42d4-9f47-985ff927173f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:54.472139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3896f1-82b6-42d8-807d-6873b4552a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:54.472756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3896f1-82b6-42d8-807d-6873b4552a7f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:54.473035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3896f1-82b6-42d8-807d-6873b4552a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:54.473309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3896f1-82b6-42d8-807d-6873b4552a7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:54.480716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3896f1-82b6-42d8-807d-6873b4552a7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:54.482459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3896f1-82b6-42d8-807d-6873b4552a7f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:54.494355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 527/1055] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:54 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:54.501251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371db2c8-f2f4-4605-ab28-45e3de7523f4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:54.510484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371db2c8-f2f4-4605-ab28-45e3de7523f4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:54.515016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20deddff-e91d-4254-ad5b-18dceb18ee0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:54.515826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deddff-e91d-4254-ad5b-18dceb18ee0a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:54.516098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deddff-e91d-4254-ad5b-18dceb18ee0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:54.516366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20deddff-e91d-4254-ad5b-18dceb18ee0a admin admin] PATH_INFO: `/v3/projects/4f57dca270564e15b40b0a58b6284c77` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:54.517516 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deddff-e91d-4254-ad5b-18dceb18ee0a admin admin] RBAC: Authorizing `identity:get_project(project_id=4f57dca270564e15b40b0a58b6284c77)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:54.519538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20deddff-e91d-4254-ad5b-18dceb18ee0a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:54.521415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 529/1056] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:01:54 2021] GET /identity/v3/projects/4f57dca270564e15b40b0a58b6284c77 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:54.527941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3896f1-82b6-42d8-807d-6873b4552a7f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:54.536705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3896f1-82b6-42d8-807d-6873b4552a7f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:54.541163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9b15c-95aa-4aef-bf91-dd4804a6a28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:54.541782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b15c-95aa-4aef-bf91-dd4804a6a28b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:54.542091 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b15c-95aa-4aef-bf91-dd4804a6a28b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:54.542366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9b15c-95aa-4aef-bf91-dd4804a6a28b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:54.543186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9b15c-95aa-4aef-bf91-dd4804a6a28b admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=4f57dca270564e15b40b0a58b6284c77, user.id=57039dc4b1ff4cc3b9e5655fa295a287) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:54.543494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9b15c-95aa-4aef-bf91-dd4804a6a28b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:54.545816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9b15c-95aa-4aef-bf91-dd4804a6a28b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:54.551381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 528/1057] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:01:54 2021] GET /identity/v3/role_assignments?user.id=57039dc4b1ff4cc3b9e5655fa295a287&scope.project.id=4f57dca270564e15b40b0a58b6284c77&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 608 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:56.796711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58076e1f-0d0c-46df-9a05-94a188be71b5 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:56.797281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58076e1f-0d0c-46df-9a05-94a188be71b5 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:56.797281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58076e1f-0d0c-46df-9a05-94a188be71b5 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:56.799060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 530/1058] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:56 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:56.804933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5644-c9c0-4692-bfae-bdaed598b0d7 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:56.805304 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5644-c9c0-4692-bfae-bdaed598b0d7 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:56.805472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e5644-c9c0-4692-bfae-bdaed598b0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:56.823112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f03e5644-c9c0-4692-bfae-bdaed598b0d7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:56.824274 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f03e5644-c9c0-4692-bfae-bdaed598b0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:56.831739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 529/1059] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:56 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:56.854745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58076e1f-0d0c-46df-9a05-94a188be71b5 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:56.867129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58076e1f-0d0c-46df-9a05-94a188be71b5 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:56.871454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769bdd-2072-4870-ab6f-3b44441f9e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:56.872068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769bdd-2072-4870-ab6f-3b44441f9e8c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:56.872345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769bdd-2072-4870-ab6f-3b44441f9e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:56.872616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769bdd-2072-4870-ab6f-3b44441f9e8c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:56.880613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3769bdd-2072-4870-ab6f-3b44441f9e8c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:56.882360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3769bdd-2072-4870-ab6f-3b44441f9e8c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:56.891040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 531/1060] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:01:56 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:01:56.897579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5644-c9c0-4692-bfae-bdaed598b0d7 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:56.906731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e5644-c9c0-4692-bfae-bdaed598b0d7 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:56.911040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83807abb-b14a-484e-8316-ccb6f38b2f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:56.911803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807abb-b14a-484e-8316-ccb6f38b2f77 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:56.912075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807abb-b14a-484e-8316-ccb6f38b2f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:56.912339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83807abb-b14a-484e-8316-ccb6f38b2f77 admin admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:56.918914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807abb-b14a-484e-8316-ccb6f38b2f77 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:56.921627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83807abb-b14a-484e-8316-ccb6f38b2f77 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:56.934771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-83807abb-b14a-484e-8316-ccb6f38b2f77 admin admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 27 01:01:56.935903 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 530/1061] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:01:56 2021] GET /identity/v3/domains/swift_test => generated 90 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:01:56.942510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769bdd-2072-4870-ab6f-3b44441f9e8c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:56.951187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769bdd-2072-4870-ab6f-3b44441f9e8c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:56.956023 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccf775-a007-4033-86e9-eb2c4bf4961a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:56.956667 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccf775-a007-4033-86e9-eb2c4bf4961a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:56.956945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccf775-a007-4033-86e9-eb2c4bf4961a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:56.957218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccf775-a007-4033-86e9-eb2c4bf4961a admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:56.957941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccf775-a007-4033-86e9-eb2c4bf4961a admin admin] RBAC: Adding query filter params (name=swift_test) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:01:56.958275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccf775-a007-4033-86e9-eb2c4bf4961a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:56.959838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccf775-a007-4033-86e9-eb2c4bf4961a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:56.967507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 532/1062] 10.222.0.32 () {56 vars in 1136 bytes} [Wed Oct 27 01:01:56 2021] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:01:59.196350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdfc02-98ef-43d0-8067-e941db17d05b None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:59.196904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdfc02-98ef-43d0-8067-e941db17d05b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:59.196904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdfc02-98ef-43d0-8067-e941db17d05b None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:59.198668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 531/1063] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:01:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:01:59.204654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14686439-e514-46bc-baee-a94d11b94de5 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:59.205091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14686439-e514-46bc-baee-a94d11b94de5 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:59.205193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14686439-e514-46bc-baee-a94d11b94de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:59.222896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-14686439-e514-46bc-baee-a94d11b94de5 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:01:59.224072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-14686439-e514-46bc-baee-a94d11b94de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:01:59.231530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 533/1064] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:01:59 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:01:59.255383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdfc02-98ef-43d0-8067-e941db17d05b None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:01:59.267148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdfc02-98ef-43d0-8067-e941db17d05b None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:01:59.271623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6f6d79-8b80-4eb1-8cee-46f2a0e59c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:01:59.272243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f6d79-8b80-4eb1-8cee-46f2a0e59c39 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:01:59.272515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f6d79-8b80-4eb1-8cee-46f2a0e59c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:01:59.272782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6f6d79-8b80-4eb1-8cee-46f2a0e59c39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:01:59.273521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f6d79-8b80-4eb1-8cee-46f2a0e59c39 admin admin] RBAC: Authorizing `identity:create_domain()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:01:59.274605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-fa6f6d79-8b80-4eb1-8cee-46f2a0e59c39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:create_domain failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:01:59.274605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:01:59.274605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:01:59.275451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6f6d79-8b80-4eb1-8cee-46f2a0e59c39 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:01:59.371737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 532/1065] 10.222.0.32 () {60 vars in 1159 bytes} [Wed Oct 27 01:01:59 2021] POST /identity/v3/domains => generated 267 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:02:01.622254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467ee51-000b-454a-888d-77e9822c6d46 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:01.622783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467ee51-000b-454a-888d-77e9822c6d46 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:01.622783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6467ee51-000b-454a-888d-77e9822c6d46 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:01.625435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 534/1066] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:02:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:02:01.631310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b611-ecd5-4215-854f-33eeaf9c50c5 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:01.631708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b611-ecd5-4215-854f-33eeaf9c50c5 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:01.631850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428b611-ecd5-4215-854f-33eeaf9c50c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:01.649874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-6428b611-ecd5-4215-854f-33eeaf9c50c5 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:02:01.651071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-6428b611-ecd5-4215-854f-33eeaf9c50c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:02:01.705530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 533/1067] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:02:01 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:02:01.729905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467ee51-000b-454a-888d-77e9822c6d46 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:01.741839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6467ee51-000b-454a-888d-77e9822c6d46 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:01.746151 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5501939-f1f6-4bd8-92b4-e78e64404815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:01.746979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5501939-f1f6-4bd8-92b4-e78e64404815 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:01.747249 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5501939-f1f6-4bd8-92b4-e78e64404815 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:01.747514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5501939-f1f6-4bd8-92b4-e78e64404815 admin admin] PATH_INFO: `/v3/domains/fbba8fbd381b4b93abeaa50b036a2301` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:01.758281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5501939-f1f6-4bd8-92b4-e78e64404815 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=fbba8fbd381b4b93abeaa50b036a2301)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:01.760201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5501939-f1f6-4bd8-92b4-e78e64404815 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:01.761766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 535/1068] 10.222.0.32 () {56 vars in 1204 bytes} [Wed Oct 27 01:02:01 2021] GET /identity/v3/domains/fbba8fbd381b4b93abeaa50b036a2301 => generated 267 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:02:01.768437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b611-ecd5-4215-854f-33eeaf9c50c5 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:01.777203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428b611-ecd5-4215-854f-33eeaf9c50c5 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:01.781581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec64442b-72f3-40ee-a537-b7d96f07259a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:01.782258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64442b-72f3-40ee-a537-b7d96f07259a admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:01.782533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64442b-72f3-40ee-a537-b7d96f07259a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:01.782799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec64442b-72f3-40ee-a537-b7d96f07259a admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:01.783499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64442b-72f3-40ee-a537-b7d96f07259a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:01.785334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec64442b-72f3-40ee-a537-b7d96f07259a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:01.877785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 534/1069] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:02:01 2021] POST /identity/v3/projects => generated 361 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:02:04.144659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057bded-4122-4c3c-b6a6-1361ccebc373 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:04.145179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057bded-4122-4c3c-b6a6-1361ccebc373 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:04.145179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057bded-4122-4c3c-b6a6-1361ccebc373 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:04.147004 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 536/1070] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:02:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:02:04.152774 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b070ff-ded7-4080-b39d-ecca5252db24 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:04.153167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b070ff-ded7-4080-b39d-ecca5252db24 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:04.153317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b070ff-ded7-4080-b39d-ecca5252db24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:04.172118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-00b070ff-ded7-4080-b39d-ecca5252db24 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:02:04.173286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-00b070ff-ded7-4080-b39d-ecca5252db24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:02:04.226555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 535/1071] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:02:04 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:02:04.253099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057bded-4122-4c3c-b6a6-1361ccebc373 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:04.265422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057bded-4122-4c3c-b6a6-1361ccebc373 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:04.269989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b78055-d0f9-46f5-be1a-b583fdfa6d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:04.270844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b78055-d0f9-46f5-be1a-b583fdfa6d71 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:04.271120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b78055-d0f9-46f5-be1a-b583fdfa6d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:04.271390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b78055-d0f9-46f5-be1a-b583fdfa6d71 admin admin] PATH_INFO: `/v3/domains/fbba8fbd381b4b93abeaa50b036a2301` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:04.272551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b78055-d0f9-46f5-be1a-b583fdfa6d71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=fbba8fbd381b4b93abeaa50b036a2301)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:04.274507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b78055-d0f9-46f5-be1a-b583fdfa6d71 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:04.276048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 537/1072] 10.222.0.32 () {56 vars in 1204 bytes} [Wed Oct 27 01:02:04 2021] GET /identity/v3/domains/fbba8fbd381b4b93abeaa50b036a2301 => generated 267 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:02:04.282296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b070ff-ded7-4080-b39d-ecca5252db24 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:04.291685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b070ff-ded7-4080-b39d-ecca5252db24 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:04.296629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a430f3-1830-41cb-81e3-49b0e7e820c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:04.297275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a430f3-1830-41cb-81e3-49b0e7e820c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:04.297558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a430f3-1830-41cb-81e3-49b0e7e820c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:04.297826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a430f3-1830-41cb-81e3-49b0e7e820c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:04.298577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a430f3-1830-41cb-81e3-49b0e7e820c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:04.300478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a430f3-1830-41cb-81e3-49b0e7e820c3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:04.410996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 536/1073] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:02:04 2021] POST /identity/v3/users => generated 311 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:02:06.703949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec89fb1-a1e8-4bd5-893f-9e5275abfb05 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:06.704578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec89fb1-a1e8-4bd5-893f-9e5275abfb05 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:06.704578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec89fb1-a1e8-4bd5-893f-9e5275abfb05 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:06.706309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 538/1074] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:02:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:02:06.712163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5c3c8-1d2b-452e-bc1c-0dac02ecd4c0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:06.712579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5c3c8-1d2b-452e-bc1c-0dac02ecd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:06.712730 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c5c3c8-1d2b-452e-bc1c-0dac02ecd4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:06.730432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-31c5c3c8-1d2b-452e-bc1c-0dac02ecd4c0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:02:06.731697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-31c5c3c8-1d2b-452e-bc1c-0dac02ecd4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:02:06.739900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 537/1075] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:02:06 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:02:06.764018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec89fb1-a1e8-4bd5-893f-9e5275abfb05 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:06.776012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec89fb1-a1e8-4bd5-893f-9e5275abfb05 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:06.780914 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000e19b-b471-4603-93c1-a511321c9ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:06.781662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000e19b-b471-4603-93c1-a511321c9ec5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:06.781936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000e19b-b471-4603-93c1-a511321c9ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:06.782232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8000e19b-b471-4603-93c1-a511321c9ec5 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:06.792316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8000e19b-b471-4603-93c1-a511321c9ec5 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:02:06.799639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-8000e19b-b471-4603-93c1-a511321c9ec5 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:02:06.800770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 539/1076] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:02:06 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:02:06.806988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5c3c8-1d2b-452e-bc1c-0dac02ecd4c0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:06.815709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c5c3c8-1d2b-452e-bc1c-0dac02ecd4c0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:06.820049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c646-2bad-4799-87d2-6e1ac6f2437c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:06.820684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c646-2bad-4799-87d2-6e1ac6f2437c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:06.820959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c646-2bad-4799-87d2-6e1ac6f2437c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:06.821231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6181c646-2bad-4799-87d2-6e1ac6f2437c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:06.821972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c646-2bad-4799-87d2-6e1ac6f2437c admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:02:06.822300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c646-2bad-4799-87d2-6e1ac6f2437c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:06.823874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6181c646-2bad-4799-87d2-6e1ac6f2437c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:06.832009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 538/1077] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:02:06 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:02:06.837996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000e19b-b471-4603-93c1-a511321c9ec5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:06.847696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8000e19b-b471-4603-93c1-a511321c9ec5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:06.852087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a038-654f-4241-88d0-f753162800cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:06.852896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a038-654f-4241-88d0-f753162800cd admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:06.853175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a038-654f-4241-88d0-f753162800cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:06.853446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d9a038-654f-4241-88d0-f753162800cd admin admin] PATH_INFO: `/v3/users/85cd8e94d936426c9514367bad28c715` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:06.867145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9a038-654f-4241-88d0-f753162800cd admin admin] RBAC: Authorizing `identity:get_user(user_id=85cd8e94d936426c9514367bad28c715)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:06.869225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d9a038-654f-4241-88d0-f753162800cd admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:06.870830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 540/1078] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:02:06 2021] GET /identity/v3/users/85cd8e94d936426c9514367bad28c715 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:02:06.877594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c646-2bad-4799-87d2-6e1ac6f2437c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:06.886921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6181c646-2bad-4799-87d2-6e1ac6f2437c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:06.892004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001a637-03e6-4b3c-b7d3-e80ed0187c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:06.892620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001a637-03e6-4b3c-b7d3-e80ed0187c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:06.892897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001a637-03e6-4b3c-b7d3-e80ed0187c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:06.893168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001a637-03e6-4b3c-b7d3-e80ed0187c44 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:06.900855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001a637-03e6-4b3c-b7d3-e80ed0187c44 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:06.902614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5001a637-03e6-4b3c-b7d3-e80ed0187c44 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:06.911344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 539/1079] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:02:06 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:02:06.917522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a038-654f-4241-88d0-f753162800cd admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:06.926590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d9a038-654f-4241-88d0-f753162800cd admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:06.930931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348fadf-a48b-4cd9-ad6f-9730d1a81941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:06.931743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348fadf-a48b-4cd9-ad6f-9730d1a81941 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:06.932017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348fadf-a48b-4cd9-ad6f-9730d1a81941 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:06.932283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348fadf-a48b-4cd9-ad6f-9730d1a81941 admin admin] PATH_INFO: `/v3/projects/48e043513d104d7bae45a9a675c73782` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:06.933417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348fadf-a48b-4cd9-ad6f-9730d1a81941 admin admin] RBAC: Authorizing `identity:get_project(project_id=48e043513d104d7bae45a9a675c73782)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:06.935989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348fadf-a48b-4cd9-ad6f-9730d1a81941 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:06.937726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 541/1080] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:02:06 2021] GET /identity/v3/projects/48e043513d104d7bae45a9a675c73782 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:02:06.943696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001a637-03e6-4b3c-b7d3-e80ed0187c44 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:06.952670 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001a637-03e6-4b3c-b7d3-e80ed0187c44 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:06.957141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971cfe3-befd-4dd6-8da5-dd8725a634ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:06.957695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971cfe3-befd-4dd6-8da5-dd8725a634ba admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:06.957978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971cfe3-befd-4dd6-8da5-dd8725a634ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:06.958281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971cfe3-befd-4dd6-8da5-dd8725a634ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:06.959097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971cfe3-befd-4dd6-8da5-dd8725a634ba admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=48e043513d104d7bae45a9a675c73782, user.id=85cd8e94d936426c9514367bad28c715) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:02:06.959401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971cfe3-befd-4dd6-8da5-dd8725a634ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:06.961175 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971cfe3-befd-4dd6-8da5-dd8725a634ba admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:06.966361 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 540/1081] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:02:06 2021] GET /identity/v3/role_assignments?user.id=85cd8e94d936426c9514367bad28c715&scope.project.id=48e043513d104d7bae45a9a675c73782&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 259 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:02:09.161000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead3724-2154-448c-b361-ef66f5c5e554 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:09.161539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead3724-2154-448c-b361-ef66f5c5e554 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:09.161539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eead3724-2154-448c-b361-ef66f5c5e554 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:09.163315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 542/1082] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:02:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:02:09.169098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af197d-013a-41d7-a2f2-a85d9ca7b9f4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:09.169594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af197d-013a-41d7-a2f2-a85d9ca7b9f4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:09.169693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29af197d-013a-41d7-a2f2-a85d9ca7b9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:09.187241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-29af197d-013a-41d7-a2f2-a85d9ca7b9f4 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:02:09.188387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-29af197d-013a-41d7-a2f2-a85d9ca7b9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:02:09.195725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 541/1083] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:02:09 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:02:09.219583 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead3724-2154-448c-b361-ef66f5c5e554 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:09.231143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eead3724-2154-448c-b361-ef66f5c5e554 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:09.236224 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb01806-261f-4ec8-bc36-e7c1efb59bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:09.236980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb01806-261f-4ec8-bc36-e7c1efb59bcf admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:09.237252 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb01806-261f-4ec8-bc36-e7c1efb59bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:09.237523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb01806-261f-4ec8-bc36-e7c1efb59bcf admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:09.247253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb01806-261f-4ec8-bc36-e7c1efb59bcf admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:02:09.253923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-9cb01806-261f-4ec8-bc36-e7c1efb59bcf admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:02:09.255014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 543/1084] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:02:09 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:02:09.261538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af197d-013a-41d7-a2f2-a85d9ca7b9f4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:09.270950 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29af197d-013a-41d7-a2f2-a85d9ca7b9f4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:09.275307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278257d0-6864-4b18-b855-ba9e50da266d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:09.275942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278257d0-6864-4b18-b855-ba9e50da266d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:09.276215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278257d0-6864-4b18-b855-ba9e50da266d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:09.276480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278257d0-6864-4b18-b855-ba9e50da266d admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:09.277219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278257d0-6864-4b18-b855-ba9e50da266d admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:02:09.277515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278257d0-6864-4b18-b855-ba9e50da266d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:09.279716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278257d0-6864-4b18-b855-ba9e50da266d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:09.287587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 542/1085] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:02:09 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:02:09.293713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb01806-261f-4ec8-bc36-e7c1efb59bcf admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:09.303671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb01806-261f-4ec8-bc36-e7c1efb59bcf admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:09.308118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9d6f-46d5-467f-b872-0b1e9c02238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:09.308934 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9d6f-46d5-467f-b872-0b1e9c02238c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:09.309214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9d6f-46d5-467f-b872-0b1e9c02238c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:09.309487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29d9d6f-46d5-467f-b872-0b1e9c02238c admin admin] PATH_INFO: `/v3/users/85cd8e94d936426c9514367bad28c715` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:09.310873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d9d6f-46d5-467f-b872-0b1e9c02238c admin admin] RBAC: Authorizing `identity:get_user(user_id=85cd8e94d936426c9514367bad28c715)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:09.312947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29d9d6f-46d5-467f-b872-0b1e9c02238c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:09.314532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 544/1086] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:02:09 2021] GET /identity/v3/users/85cd8e94d936426c9514367bad28c715 => generated 311 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:02:09.320585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278257d0-6864-4b18-b855-ba9e50da266d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:09.330432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278257d0-6864-4b18-b855-ba9e50da266d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:09.334785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7005239-d712-45b4-8b8f-ba123028e012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:09.335594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7005239-d712-45b4-8b8f-ba123028e012 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:09.335868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7005239-d712-45b4-8b8f-ba123028e012 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:09.336133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7005239-d712-45b4-8b8f-ba123028e012 admin admin] PATH_INFO: `/v3/projects/48e043513d104d7bae45a9a675c73782` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:09.337269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7005239-d712-45b4-8b8f-ba123028e012 admin admin] RBAC: Authorizing `identity:get_project(project_id=48e043513d104d7bae45a9a675c73782)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:09.339277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7005239-d712-45b4-8b8f-ba123028e012 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:09.340853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 543/1087] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:02:09 2021] GET /identity/v3/projects/48e043513d104d7bae45a9a675c73782 => generated 361 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:02:09.347509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9d6f-46d5-467f-b872-0b1e9c02238c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:09.356568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29d9d6f-46d5-467f-b872-0b1e9c02238c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:09.361007 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a6b346-9423-4e65-9c52-453ef4f28ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:09.361836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6b346-9423-4e65-9c52-453ef4f28ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:09.362151 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6b346-9423-4e65-9c52-453ef4f28ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:09.362427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a6b346-9423-4e65-9c52-453ef4f28ff9 admin admin] PATH_INFO: `/v3/projects/48e043513d104d7bae45a9a675c73782/users/85cd8e94d936426c9514367bad28c715/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:09.364343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6b346-9423-4e65-9c52-453ef4f28ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48e043513d104d7bae45a9a675c73782, user_id=85cd8e94d936426c9514367bad28c715, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:09.367017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a6b346-9423-4e65-9c52-453ef4f28ff9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:09.461005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 545/1088] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:02:09 2021] PUT /identity/v3/projects/48e043513d104d7bae45a9a675c73782/users/85cd8e94d936426c9514367bad28c715/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:02:11.719893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014379-1c86-4d5b-86db-56df5a186fdd None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:11.720430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014379-1c86-4d5b-86db-56df5a186fdd None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:11.720430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82014379-1c86-4d5b-86db-56df5a186fdd None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:11.722218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 544/1089] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:02:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:02:11.728126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c51c4-5676-4c8a-9362-2744263fe67b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:11.728553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c51c4-5676-4c8a-9362-2744263fe67b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:11.728664 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c51c4-5676-4c8a-9362-2744263fe67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:11.746635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1f9c51c4-5676-4c8a-9362-2744263fe67b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:02:11.748696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1f9c51c4-5676-4c8a-9362-2744263fe67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:02:11.803159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 546/1090] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:02:11 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:02:11.828039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82014379-1c86-4d5b-86db-56df5a186fdd None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:11.839760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82014379-1c86-4d5b-86db-56df5a186fdd None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:11.844205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b335e53-9900-45ec-96c9-9db60f1dddc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:11.844963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b335e53-9900-45ec-96c9-9db60f1dddc2 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:11.845241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b335e53-9900-45ec-96c9-9db60f1dddc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:11.845513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b335e53-9900-45ec-96c9-9db60f1dddc2 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:11.855275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b335e53-9900-45ec-96c9-9db60f1dddc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:02:11.862593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-6b335e53-9900-45ec-96c9-9db60f1dddc2 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:02:11.863700 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 545/1091] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:02:11 2021] GET /identity/v3/roles/admin => generated 83 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:02:11.869993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c51c4-5676-4c8a-9362-2744263fe67b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:11.879505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c51c4-5676-4c8a-9362-2744263fe67b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:11.883911 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72ec2-0103-462e-baf2-879de0a5cafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:11.884551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72ec2-0103-462e-baf2-879de0a5cafc admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:11.884830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72ec2-0103-462e-baf2-879de0a5cafc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:11.885104 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f72ec2-0103-462e-baf2-879de0a5cafc admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:11.885850 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f72ec2-0103-462e-baf2-879de0a5cafc admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:02:11.886183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f72ec2-0103-462e-baf2-879de0a5cafc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:11.887738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f72ec2-0103-462e-baf2-879de0a5cafc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:11.896185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 547/1092] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:02:11 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:02:11.902143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b335e53-9900-45ec-96c9-9db60f1dddc2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:11.912379 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b335e53-9900-45ec-96c9-9db60f1dddc2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:11.916724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e605c79-7a0e-4012-b8c1-f881278b7ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:11.917531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e605c79-7a0e-4012-b8c1-f881278b7ebc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:11.917801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e605c79-7a0e-4012-b8c1-f881278b7ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:11.918097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e605c79-7a0e-4012-b8c1-f881278b7ebc admin admin] PATH_INFO: `/v3/users/85cd8e94d936426c9514367bad28c715` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:11.919937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e605c79-7a0e-4012-b8c1-f881278b7ebc admin admin] RBAC: Authorizing `identity:get_user(user_id=85cd8e94d936426c9514367bad28c715)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:11.922137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e605c79-7a0e-4012-b8c1-f881278b7ebc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:11.923657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 546/1093] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:02:11 2021] GET /identity/v3/users/85cd8e94d936426c9514367bad28c715 => generated 311 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:02:11.929569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72ec2-0103-462e-baf2-879de0a5cafc admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:11.938639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f72ec2-0103-462e-baf2-879de0a5cafc admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:11.943025 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384c7c2-d750-41fa-8cd1-fcd37d8f8fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:11.943629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384c7c2-d750-41fa-8cd1-fcd37d8f8fdd admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:11.943908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384c7c2-d750-41fa-8cd1-fcd37d8f8fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:11.944177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a384c7c2-d750-41fa-8cd1-fcd37d8f8fdd admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:11.951800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384c7c2-d750-41fa-8cd1-fcd37d8f8fdd admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:11.953461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a384c7c2-d750-41fa-8cd1-fcd37d8f8fdd admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:11.961858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 548/1094] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:02:11 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:02:11.968436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e605c79-7a0e-4012-b8c1-f881278b7ebc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:11.977611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e605c79-7a0e-4012-b8c1-f881278b7ebc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:11.982319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74943663-6c99-44ae-a52c-4d003d5c9803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:11.983147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943663-6c99-44ae-a52c-4d003d5c9803 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:11.983418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943663-6c99-44ae-a52c-4d003d5c9803 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:11.983679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74943663-6c99-44ae-a52c-4d003d5c9803 admin admin] PATH_INFO: `/v3/projects/48e043513d104d7bae45a9a675c73782` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:11.984839 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74943663-6c99-44ae-a52c-4d003d5c9803 admin admin] RBAC: Authorizing `identity:get_project(project_id=48e043513d104d7bae45a9a675c73782)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:11.986864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74943663-6c99-44ae-a52c-4d003d5c9803 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:11.988464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 547/1095] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:02:11 2021] GET /identity/v3/projects/48e043513d104d7bae45a9a675c73782 => generated 361 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:02:11.994860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384c7c2-d750-41fa-8cd1-fcd37d8f8fdd admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:02:12.003508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a384c7c2-d750-41fa-8cd1-fcd37d8f8fdd admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:02:12.007878 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9264af7-02e1-4ffe-beda-1399bb954bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:02:12.008493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9264af7-02e1-4ffe-beda-1399bb954bee admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:02:12.008767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9264af7-02e1-4ffe-beda-1399bb954bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:02:12.009034 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9264af7-02e1-4ffe-beda-1399bb954bee admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:02:12.009852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9264af7-02e1-4ffe-beda-1399bb954bee admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=48e043513d104d7bae45a9a675c73782, user.id=85cd8e94d936426c9514367bad28c715) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:02:12.010185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9264af7-02e1-4ffe-beda-1399bb954bee admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:02:12.011987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9264af7-02e1-4ffe-beda-1399bb954bee admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:02:12.017646 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 549/1096] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:02:11 2021] GET /identity/v3/role_assignments?user.id=85cd8e94d936426c9514367bad28c715&scope.project.id=48e043513d104d7bae45a9a675c73782&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 608 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:03:25.645166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ef55-5d43-4901-91ff-fc1242f8a4ef None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:25.645760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ef55-5d43-4901-91ff-fc1242f8a4ef None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:25.645760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f2ef55-5d43-4901-91ff-fc1242f8a4ef None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:25.647494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 548/1097] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:25 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:25.653551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7886dd2-3060-4c20-8ef8-e9648c8a882b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:25.653982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7886dd2-3060-4c20-8ef8-e9648c8a882b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:25.654110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7886dd2-3060-4c20-8ef8-e9648c8a882b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:25.671794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e7886dd2-3060-4c20-8ef8-e9648c8a882b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:25.672962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e7886dd2-3060-4c20-8ef8-e9648c8a882b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:25.680421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 550/1098] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:25 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:25.707436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ef55-5d43-4901-91ff-fc1242f8a4ef None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:25.719663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f2ef55-5d43-4901-91ff-fc1242f8a4ef None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:25.724017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1aa6ab-54af-40af-aa16-722da13ab50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:25.724781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1aa6ab-54af-40af-aa16-722da13ab50f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:25.725058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1aa6ab-54af-40af-aa16-722da13ab50f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:25.725328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1aa6ab-54af-40af-aa16-722da13ab50f admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:25.735385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1aa6ab-54af-40af-aa16-722da13ab50f admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:25.737208 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1aa6ab-54af-40af-aa16-722da13ab50f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:25.754102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-dd1aa6ab-54af-40af-aa16-722da13ab50f admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:25.755238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 549/1099] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:25 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:03:25.762421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7886dd2-3060-4c20-8ef8-e9648c8a882b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:25.771338 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7886dd2-3060-4c20-8ef8-e9648c8a882b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:25.775800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d01fd-5ffc-45d1-a7e8-48a8598e263e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:25.776434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d01fd-5ffc-45d1-a7e8-48a8598e263e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:25.776703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d01fd-5ffc-45d1-a7e8-48a8598e263e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:25.776970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d01fd-5ffc-45d1-a7e8-48a8598e263e admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:25.777684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d01fd-5ffc-45d1-a7e8-48a8598e263e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:25.777979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d01fd-5ffc-45d1-a7e8-48a8598e263e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:25.779592 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d01fd-5ffc-45d1-a7e8-48a8598e263e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:25.790548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 551/1100] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:25.797848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1aa6ab-54af-40af-aa16-722da13ab50f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:25.808467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1aa6ab-54af-40af-aa16-722da13ab50f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:25.812987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b81af-5236-4cab-92b6-499738ed902c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:25.813631 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b81af-5236-4cab-92b6-499738ed902c admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:25.813912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b81af-5236-4cab-92b6-499738ed902c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:25.814212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b81af-5236-4cab-92b6-499738ed902c admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:25.814925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b81af-5236-4cab-92b6-499738ed902c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:25.816823 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b81af-5236-4cab-92b6-499738ed902c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:25.910266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 550/1101] 10.222.0.32 () {60 vars in 1153 bytes} [Wed Oct 27 01:03:25 2021] POST /identity/v3/users => generated 251 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:03:28.221226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27262a-c47e-4ec3-946e-8cb09e2f5708 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.221808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27262a-c47e-4ec3-946e-8cb09e2f5708 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.221808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27262a-c47e-4ec3-946e-8cb09e2f5708 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.223578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 552/1102] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:28 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:28.230148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfc20e-509d-4c88-b21b-978915f3cccc None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.230562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfc20e-509d-4c88-b21b-978915f3cccc None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.230694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cfc20e-509d-4c88-b21b-978915f3cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.249783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-01cfc20e-509d-4c88-b21b-978915f3cccc None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:28.251043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-01cfc20e-509d-4c88-b21b-978915f3cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:28.258543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 551/1103] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:28 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:28.283158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27262a-c47e-4ec3-946e-8cb09e2f5708 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.295693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27262a-c47e-4ec3-946e-8cb09e2f5708 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.300089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c8618-e788-4a7d-9b6a-87deefbd8f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.300846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8618-e788-4a7d-9b6a-87deefbd8f6a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.301120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8618-e788-4a7d-9b6a-87deefbd8f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.301384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8618-e788-4a7d-9b6a-87deefbd8f6a admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.312490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c8618-e788-4a7d-9b6a-87deefbd8f6a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:03:28.319285 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-c80c8618-e788-4a7d-9b6a-87deefbd8f6a admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:03:28.322560 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 553/1104] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:28.326845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfc20e-509d-4c88-b21b-978915f3cccc None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.335620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cfc20e-509d-4c88-b21b-978915f3cccc None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.340172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afef7f-a053-48db-a4c7-431a8f9e4969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.340816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afef7f-a053-48db-a4c7-431a8f9e4969 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.341097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afef7f-a053-48db-a4c7-431a8f9e4969 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.341355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53afef7f-a053-48db-a4c7-431a8f9e4969 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.342132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afef7f-a053-48db-a4c7-431a8f9e4969 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:28.342435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afef7f-a053-48db-a4c7-431a8f9e4969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.344009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53afef7f-a053-48db-a4c7-431a8f9e4969 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.351869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 552/1105] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:28.358784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c8618-e788-4a7d-9b6a-87deefbd8f6a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.368286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c8618-e788-4a7d-9b6a-87deefbd8f6a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.373742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da8f9a-5ca5-411e-b413-558bb903c6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.374615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da8f9a-5ca5-411e-b413-558bb903c6c2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.374836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da8f9a-5ca5-411e-b413-558bb903c6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.375109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42da8f9a-5ca5-411e-b413-558bb903c6c2 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.385523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da8f9a-5ca5-411e-b413-558bb903c6c2 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.387416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42da8f9a-5ca5-411e-b413-558bb903c6c2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.404892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-42da8f9a-5ca5-411e-b413-558bb903c6c2 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:28.406047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 554/1106] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:28.412594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afef7f-a053-48db-a4c7-431a8f9e4969 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.422871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53afef7f-a053-48db-a4c7-431a8f9e4969 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.427418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978c84-ac84-4914-a5ad-dbcb90a57e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.428059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978c84-ac84-4914-a5ad-dbcb90a57e64 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.428337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978c84-ac84-4914-a5ad-dbcb90a57e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.428607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd978c84-ac84-4914-a5ad-dbcb90a57e64 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.429325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978c84-ac84-4914-a5ad-dbcb90a57e64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:28.429625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978c84-ac84-4914-a5ad-dbcb90a57e64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.431279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd978c84-ac84-4914-a5ad-dbcb90a57e64 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.442724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 553/1107] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:28.449140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da8f9a-5ca5-411e-b413-558bb903c6c2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.458756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42da8f9a-5ca5-411e-b413-558bb903c6c2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.463809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea37d08-182a-4c71-8b57-bbc6d486c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.464571 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea37d08-182a-4c71-8b57-bbc6d486c456 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.464847 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea37d08-182a-4c71-8b57-bbc6d486c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.465113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea37d08-182a-4c71-8b57-bbc6d486c456 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.472209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea37d08-182a-4c71-8b57-bbc6d486c456 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.474336 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea37d08-182a-4c71-8b57-bbc6d486c456 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.489432 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-fea37d08-182a-4c71-8b57-bbc6d486c456 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:03:28.490569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 555/1108] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/users/placement => generated 87 bytes in 42 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:03:28.497628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978c84-ac84-4914-a5ad-dbcb90a57e64 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.507400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd978c84-ac84-4914-a5ad-dbcb90a57e64 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.512008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8897c-5450-466e-9e9e-f4d5d6d2b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.512645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8897c-5450-466e-9e9e-f4d5d6d2b735 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.512916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8897c-5450-466e-9e9e-f4d5d6d2b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.513220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8897c-5450-466e-9e9e-f4d5d6d2b735 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.514160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8897c-5450-466e-9e9e-f4d5d6d2b735 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:28.514466 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8897c-5450-466e-9e9e-f4d5d6d2b735 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.516254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8897c-5450-466e-9e9e-f4d5d6d2b735 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.533690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 554/1109] 10.222.0.32 () {56 vars in 1164 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:28.539978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea37d08-182a-4c71-8b57-bbc6d486c456 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.550286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea37d08-182a-4c71-8b57-bbc6d486c456 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.554763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a15ced-1437-4028-826e-b2bc9eaf9cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.555379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a15ced-1437-4028-826e-b2bc9eaf9cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.555653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a15ced-1437-4028-826e-b2bc9eaf9cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.555919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a15ced-1437-4028-826e-b2bc9eaf9cb7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.563841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a15ced-1437-4028-826e-b2bc9eaf9cb7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.565546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a15ced-1437-4028-826e-b2bc9eaf9cb7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.574349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 556/1110] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:03:28.580812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8897c-5450-466e-9e9e-f4d5d6d2b735 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.591148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8897c-5450-466e-9e9e-f4d5d6d2b735 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.595635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa076b-1c86-4fd5-8783-24f059a82f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.596399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa076b-1c86-4fd5-8783-24f059a82f17 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.596679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa076b-1c86-4fd5-8783-24f059a82f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.596951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaa076b-1c86-4fd5-8783-24f059a82f17 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.607811 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa076b-1c86-4fd5-8783-24f059a82f17 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.609607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaa076b-1c86-4fd5-8783-24f059a82f17 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.626272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-eaaa076b-1c86-4fd5-8783-24f059a82f17 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:28.627380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 555/1111] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:28.633406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a15ced-1437-4028-826e-b2bc9eaf9cb7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.642566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a15ced-1437-4028-826e-b2bc9eaf9cb7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.647086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7e154-5387-4c60-9d5f-bed7ba9707bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.647717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7e154-5387-4c60-9d5f-bed7ba9707bb admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.647988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7e154-5387-4c60-9d5f-bed7ba9707bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.648253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7e154-5387-4c60-9d5f-bed7ba9707bb admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.648962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7e154-5387-4c60-9d5f-bed7ba9707bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:28.649256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7e154-5387-4c60-9d5f-bed7ba9707bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.651428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7e154-5387-4c60-9d5f-bed7ba9707bb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.662491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 557/1112] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:28.669239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa076b-1c86-4fd5-8783-24f059a82f17 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.678518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaa076b-1c86-4fd5-8783-24f059a82f17 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.682977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a1994-925c-42bd-9100-2ec4494faac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.683725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a1994-925c-42bd-9100-2ec4494faac9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.683998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a1994-925c-42bd-9100-2ec4494faac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.684270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a1994-925c-42bd-9100-2ec4494faac9 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.690830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a1994-925c-42bd-9100-2ec4494faac9 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.692773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a1994-925c-42bd-9100-2ec4494faac9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.705258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-846a1994-925c-42bd-9100-2ec4494faac9 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:03:28.706411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 556/1113] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/projects/service => generated 88 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:28.713484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7e154-5387-4c60-9d5f-bed7ba9707bb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.722953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7e154-5387-4c60-9d5f-bed7ba9707bb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.727360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b657d-905a-4235-bb34-2b69e53ab0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.727987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b657d-905a-4235-bb34-2b69e53ab0d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.728263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b657d-905a-4235-bb34-2b69e53ab0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.728531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b657d-905a-4235-bb34-2b69e53ab0d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.729901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b657d-905a-4235-bb34-2b69e53ab0d4 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:28.730231 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b657d-905a-4235-bb34-2b69e53ab0d4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.732013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b657d-905a-4235-bb34-2b69e53ab0d4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.746111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 558/1114] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:28.750332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a1994-925c-42bd-9100-2ec4494faac9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:28.761088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a1994-925c-42bd-9100-2ec4494faac9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:28.765355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b511a5a3-be9b-4d6f-bcd4-5089fceeb7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:28.766008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511a5a3-be9b-4d6f-bcd4-5089fceeb7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:28.766341 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511a5a3-be9b-4d6f-bcd4-5089fceeb7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:28.766842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b511a5a3-be9b-4d6f-bcd4-5089fceeb7f0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:28.767662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511a5a3-be9b-4d6f-bcd4-5089fceeb7f0 admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=8df6e02fde834883aef230f31d6ecd94) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:28.767967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511a5a3-be9b-4d6f-bcd4-5089fceeb7f0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:28.769752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b511a5a3-be9b-4d6f-bcd4-5089fceeb7f0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:28.774916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 557/1115] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:03:28 2021] GET /identity/v3/role_assignments?user.id=8df6e02fde834883aef230f31d6ecd94&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 259 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:03:31.012168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714c91-de9a-4032-a72a-1bad1df31744 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.012601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714c91-de9a-4032-a72a-1bad1df31744 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.012691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714c91-de9a-4032-a72a-1bad1df31744 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.014489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 559/1116] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:31 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:31.020653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f5a1d-25d3-4b86-9bd2-e435a64b0e14 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.021090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f5a1d-25d3-4b86-9bd2-e435a64b0e14 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.021185 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f5a1d-25d3-4b86-9bd2-e435a64b0e14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.038406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-655f5a1d-25d3-4b86-9bd2-e435a64b0e14 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:31.039600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-655f5a1d-25d3-4b86-9bd2-e435a64b0e14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:31.047428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 558/1117] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:31 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:31.071099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714c91-de9a-4032-a72a-1bad1df31744 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.083820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714c91-de9a-4032-a72a-1bad1df31744 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.088764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078b0e-52b6-4f7c-990f-1dfb4980e33c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.089597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078b0e-52b6-4f7c-990f-1dfb4980e33c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.089870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078b0e-52b6-4f7c-990f-1dfb4980e33c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.090174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64078b0e-52b6-4f7c-990f-1dfb4980e33c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.100202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64078b0e-52b6-4f7c-990f-1dfb4980e33c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:03:31.107336 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-64078b0e-52b6-4f7c-990f-1dfb4980e33c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:03:31.108486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 560/1118] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:31.115159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f5a1d-25d3-4b86-9bd2-e435a64b0e14 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.124060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f5a1d-25d3-4b86-9bd2-e435a64b0e14 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.128532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b91e8-c1e5-438d-9c51-e830334decd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.129171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b91e8-c1e5-438d-9c51-e830334decd3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.129446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b91e8-c1e5-438d-9c51-e830334decd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.129713 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b91e8-c1e5-438d-9c51-e830334decd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.130489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b91e8-c1e5-438d-9c51-e830334decd3 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:31.130784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b91e8-c1e5-438d-9c51-e830334decd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.132353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171b91e8-c1e5-438d-9c51-e830334decd3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.140791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 559/1119] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:31.147302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078b0e-52b6-4f7c-990f-1dfb4980e33c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.157544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64078b0e-52b6-4f7c-990f-1dfb4980e33c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.162157 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8938d-7f02-4958-94d7-21ec967086b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.162908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8938d-7f02-4958-94d7-21ec967086b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.163185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8938d-7f02-4958-94d7-21ec967086b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.163454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8938d-7f02-4958-94d7-21ec967086b4 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.173931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8938d-7f02-4958-94d7-21ec967086b4 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.175817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8938d-7f02-4958-94d7-21ec967086b4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.192665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-08c8938d-7f02-4958-94d7-21ec967086b4 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:31.193772 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 561/1120] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:03:31.200081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b91e8-c1e5-438d-9c51-e830334decd3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.209458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b91e8-c1e5-438d-9c51-e830334decd3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.213960 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6bac2-7552-40fd-9307-339f10b69159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.214620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6bac2-7552-40fd-9307-339f10b69159 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.214962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6bac2-7552-40fd-9307-339f10b69159 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.215170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6bac2-7552-40fd-9307-339f10b69159 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.215865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6bac2-7552-40fd-9307-339f10b69159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:31.216162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6bac2-7552-40fd-9307-339f10b69159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.217719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6bac2-7552-40fd-9307-339f10b69159 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.229394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 560/1121] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:31.235647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8938d-7f02-4958-94d7-21ec967086b4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.245685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8938d-7f02-4958-94d7-21ec967086b4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.250200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8cb24-6b24-458e-a74b-ad407cafe4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.250908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8cb24-6b24-458e-a74b-ad407cafe4f4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.251181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8cb24-6b24-458e-a74b-ad407cafe4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.251491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b8cb24-6b24-458e-a74b-ad407cafe4f4 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.258491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8cb24-6b24-458e-a74b-ad407cafe4f4 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.260436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b8cb24-6b24-458e-a74b-ad407cafe4f4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.274177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-43b8cb24-6b24-458e-a74b-ad407cafe4f4 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:03:31.275271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 562/1122] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:31.281525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6bac2-7552-40fd-9307-339f10b69159 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.290979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6bac2-7552-40fd-9307-339f10b69159 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.296082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f923b-8405-4ac2-880d-aa327e5bc213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.296722 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f923b-8405-4ac2-880d-aa327e5bc213 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.297025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f923b-8405-4ac2-880d-aa327e5bc213 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.297271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f923b-8405-4ac2-880d-aa327e5bc213 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.298122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f923b-8405-4ac2-880d-aa327e5bc213 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:31.298420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f923b-8405-4ac2-880d-aa327e5bc213 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.300212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90f923b-8405-4ac2-880d-aa327e5bc213 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.317383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 561/1123] 10.222.0.32 () {56 vars in 1164 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:31.323733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8cb24-6b24-458e-a74b-ad407cafe4f4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.333212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b8cb24-6b24-458e-a74b-ad407cafe4f4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.337619 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e238-b457-4631-a847-440226163b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.338578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e238-b457-4631-a847-440226163b7a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.338864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e238-b457-4631-a847-440226163b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.339131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85e238-b457-4631-a847-440226163b7a admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.348873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85e238-b457-4631-a847-440226163b7a admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.350751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85e238-b457-4631-a847-440226163b7a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.367767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-0a85e238-b457-4631-a847-440226163b7a admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:31.368889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 563/1124] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:03:31.375816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f923b-8405-4ac2-880d-aa327e5bc213 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.385161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f923b-8405-4ac2-880d-aa327e5bc213 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.389691 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f240a-c9f1-40f7-b4ce-05832524ae86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.390356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f240a-c9f1-40f7-b4ce-05832524ae86 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.390637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f240a-c9f1-40f7-b4ce-05832524ae86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.390908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f240a-c9f1-40f7-b4ce-05832524ae86 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.391868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f240a-c9f1-40f7-b4ce-05832524ae86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:31.392169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f240a-c9f1-40f7-b4ce-05832524ae86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.393721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413f240a-c9f1-40f7-b4ce-05832524ae86 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.405144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 562/1125] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:31.411284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e238-b457-4631-a847-440226163b7a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.421287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85e238-b457-4631-a847-440226163b7a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.425697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0999a7-4a54-45ba-b222-409fcc0a4e0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.426477 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0999a7-4a54-45ba-b222-409fcc0a4e0c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.426753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0999a7-4a54-45ba-b222-409fcc0a4e0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.427020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0999a7-4a54-45ba-b222-409fcc0a4e0c admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.433609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0999a7-4a54-45ba-b222-409fcc0a4e0c admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.439315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0999a7-4a54-45ba-b222-409fcc0a4e0c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.448386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-df0999a7-4a54-45ba-b222-409fcc0a4e0c admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:03:31.449581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 564/1126] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:31.455869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f240a-c9f1-40f7-b4ce-05832524ae86 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.465986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f240a-c9f1-40f7-b4ce-05832524ae86 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.470537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72c3908-f2a6-4210-87e1-67095948722d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.471177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c3908-f2a6-4210-87e1-67095948722d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.471454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c3908-f2a6-4210-87e1-67095948722d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.471725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72c3908-f2a6-4210-87e1-67095948722d admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.472505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c3908-f2a6-4210-87e1-67095948722d admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:31.472807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c3908-f2a6-4210-87e1-67095948722d admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.474666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72c3908-f2a6-4210-87e1-67095948722d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.486953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 563/1127] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:03:31 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:31.493414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0999a7-4a54-45ba-b222-409fcc0a4e0c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:31.505554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0999a7-4a54-45ba-b222-409fcc0a4e0c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:31.509955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd92335-a39e-480e-97d7-a10fe74f4570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:31.510894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92335-a39e-480e-97d7-a10fe74f4570 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:31.511165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92335-a39e-480e-97d7-a10fe74f4570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:31.511429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd92335-a39e-480e-97d7-a10fe74f4570 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/8df6e02fde834883aef230f31d6ecd94/roles/4784162e8bd0416c9bc4ef9e01acb1d9` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:31.526236 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd92335-a39e-480e-97d7-a10fe74f4570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=8df6e02fde834883aef230f31d6ecd94, role_id=4784162e8bd0416c9bc4ef9e01acb1d9)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:31.528832 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd92335-a39e-480e-97d7-a10fe74f4570 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:31.721703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 565/1128] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:03:31 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/8df6e02fde834883aef230f31d6ecd94/roles/4784162e8bd0416c9bc4ef9e01acb1d9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:03:34.002703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff93c0e-da81-40d2-bdd5-79a720e366e2 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.003145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff93c0e-da81-40d2-bdd5-79a720e366e2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.003248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff93c0e-da81-40d2-bdd5-79a720e366e2 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.005004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 564/1129] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:34 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:34.011830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97bec-a2be-4334-a02d-b48746105b52 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.012275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97bec-a2be-4334-a02d-b48746105b52 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.012379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a97bec-a2be-4334-a02d-b48746105b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.030621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-00a97bec-a2be-4334-a02d-b48746105b52 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:34.031792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-00a97bec-a2be-4334-a02d-b48746105b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:34.085902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 566/1130] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:34 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:34.110886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff93c0e-da81-40d2-bdd5-79a720e366e2 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.123365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff93c0e-da81-40d2-bdd5-79a720e366e2 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.127693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61d058-bbaa-4b4d-8503-e86a3b49749c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.128467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61d058-bbaa-4b4d-8503-e86a3b49749c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.128740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61d058-bbaa-4b4d-8503-e86a3b49749c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.129005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad61d058-bbaa-4b4d-8503-e86a3b49749c admin admin] PATH_INFO: `/v3/roles/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.140002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad61d058-bbaa-4b4d-8503-e86a3b49749c admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:03:34.147256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-ad61d058-bbaa-4b4d-8503-e86a3b49749c admin admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 27 01:03:34.148418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 565/1131] 10.222.0.32 () {56 vars in 1123 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/roles/service => generated 85 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:34.155593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a97bec-a2be-4334-a02d-b48746105b52 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.165181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a97bec-a2be-4334-a02d-b48746105b52 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.169946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259b581-6d68-4870-a8c2-be56e839e8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.170627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259b581-6d68-4870-a8c2-be56e839e8e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.170903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259b581-6d68-4870-a8c2-be56e839e8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.171171 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259b581-6d68-4870-a8c2-be56e839e8e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.171970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259b581-6d68-4870-a8c2-be56e839e8e4 admin admin] RBAC: Adding query filter params (name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:34.172271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259b581-6d68-4870-a8c2-be56e839e8e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.173845 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259b581-6d68-4870-a8c2-be56e839e8e4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.181672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 567/1132] 10.222.0.32 () {56 vars in 1124 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/roles?name=service => generated 326 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:34.188412 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61d058-bbaa-4b4d-8503-e86a3b49749c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.199214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad61d058-bbaa-4b4d-8503-e86a3b49749c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.203940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b5d5c-86aa-4fc1-aadd-f192992304a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.204709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b5d5c-86aa-4fc1-aadd-f192992304a5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.204987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b5d5c-86aa-4fc1-aadd-f192992304a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.205256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624b5d5c-86aa-4fc1-aadd-f192992304a5 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.216458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b5d5c-86aa-4fc1-aadd-f192992304a5 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.218421 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624b5d5c-86aa-4fc1-aadd-f192992304a5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.234914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-624b5d5c-86aa-4fc1-aadd-f192992304a5 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:34.236041 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 566/1133] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:34.242287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259b581-6d68-4870-a8c2-be56e839e8e4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.252700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259b581-6d68-4870-a8c2-be56e839e8e4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.256779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20726e-dd96-43ee-a22e-74b5f5a34da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.257418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20726e-dd96-43ee-a22e-74b5f5a34da4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.257693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20726e-dd96-43ee-a22e-74b5f5a34da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.257960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20726e-dd96-43ee-a22e-74b5f5a34da4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.258717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20726e-dd96-43ee-a22e-74b5f5a34da4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:34.259019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20726e-dd96-43ee-a22e-74b5f5a34da4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.261099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20726e-dd96-43ee-a22e-74b5f5a34da4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.272636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 568/1134] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:34.279376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b5d5c-86aa-4fc1-aadd-f192992304a5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.288846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624b5d5c-86aa-4fc1-aadd-f192992304a5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.293682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573101f5-6fed-410c-a1b9-725ea38b44aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.294494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573101f5-6fed-410c-a1b9-725ea38b44aa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.294775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573101f5-6fed-410c-a1b9-725ea38b44aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.295044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573101f5-6fed-410c-a1b9-725ea38b44aa admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.302313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573101f5-6fed-410c-a1b9-725ea38b44aa admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.304293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573101f5-6fed-410c-a1b9-725ea38b44aa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.317760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-573101f5-6fed-410c-a1b9-725ea38b44aa admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:03:34.318900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 567/1135] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/users/placement => generated 87 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:34.325696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20726e-dd96-43ee-a22e-74b5f5a34da4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.335461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20726e-dd96-43ee-a22e-74b5f5a34da4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.340622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7745ec9-514d-46af-956e-bf432db5bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.341263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7745ec9-514d-46af-956e-bf432db5bda9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.341540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7745ec9-514d-46af-956e-bf432db5bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.341811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7745ec9-514d-46af-956e-bf432db5bda9 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.342686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7745ec9-514d-46af-956e-bf432db5bda9 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:34.342983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7745ec9-514d-46af-956e-bf432db5bda9 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.344781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7745ec9-514d-46af-956e-bf432db5bda9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.361753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 569/1136] 10.222.0.32 () {56 vars in 1164 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:34.367966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573101f5-6fed-410c-a1b9-725ea38b44aa admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.378487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573101f5-6fed-410c-a1b9-725ea38b44aa admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.383004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d220b6-567b-48da-acfe-332c880d9cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.383630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d220b6-567b-48da-acfe-332c880d9cce admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.385428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d220b6-567b-48da-acfe-332c880d9cce admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.385428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d220b6-567b-48da-acfe-332c880d9cce admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.392962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d220b6-567b-48da-acfe-332c880d9cce admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.394729 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d220b6-567b-48da-acfe-332c880d9cce admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.403653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 568/1137] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:03:34.409953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7745ec9-514d-46af-956e-bf432db5bda9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.419497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7745ec9-514d-46af-956e-bf432db5bda9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.424022 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec988e-3c1a-4cfe-908c-d712a020453e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.424790 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec988e-3c1a-4cfe-908c-d712a020453e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.425071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec988e-3c1a-4cfe-908c-d712a020453e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.425342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ec988e-3c1a-4cfe-908c-d712a020453e admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.436039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec988e-3c1a-4cfe-908c-d712a020453e admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.437843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ec988e-3c1a-4cfe-908c-d712a020453e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.455007 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-e4ec988e-3c1a-4cfe-908c-d712a020453e admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:34.456130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 570/1138] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:34.462488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d220b6-567b-48da-acfe-332c880d9cce admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.471572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d220b6-567b-48da-acfe-332c880d9cce admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.476147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a981b-3720-4d0f-9c8f-55a9640b2cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.476778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a981b-3720-4d0f-9c8f-55a9640b2cfc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.479472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a981b-3720-4d0f-9c8f-55a9640b2cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.479472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a981b-3720-4d0f-9c8f-55a9640b2cfc admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.479472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a981b-3720-4d0f-9c8f-55a9640b2cfc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:34.479472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a981b-3720-4d0f-9c8f-55a9640b2cfc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.480520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a981b-3720-4d0f-9c8f-55a9640b2cfc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.492314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 569/1139] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:34.499086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec988e-3c1a-4cfe-908c-d712a020453e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.508867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ec988e-3c1a-4cfe-908c-d712a020453e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.514322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459cf40-0db4-4755-b49e-bfa4a07e0a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.515116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459cf40-0db4-4755-b49e-bfa4a07e0a55 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.515397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459cf40-0db4-4755-b49e-bfa4a07e0a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.515668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459cf40-0db4-4755-b49e-bfa4a07e0a55 admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.522812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459cf40-0db4-4755-b49e-bfa4a07e0a55 admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.524785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459cf40-0db4-4755-b49e-bfa4a07e0a55 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.537661 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-5459cf40-0db4-4755-b49e-bfa4a07e0a55 admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:03:34.538805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 571/1140] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:03:34.545252 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a981b-3720-4d0f-9c8f-55a9640b2cfc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.555494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a981b-3720-4d0f-9c8f-55a9640b2cfc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.560496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7106b7cc-d56b-49fc-81bc-0f1286513193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.561128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b7cc-d56b-49fc-81bc-0f1286513193 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.561405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b7cc-d56b-49fc-81bc-0f1286513193 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.561673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7106b7cc-d56b-49fc-81bc-0f1286513193 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.562499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106b7cc-d56b-49fc-81bc-0f1286513193 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:34.562804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106b7cc-d56b-49fc-81bc-0f1286513193 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.564602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7106b7cc-d56b-49fc-81bc-0f1286513193 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.577149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 570/1141] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:34.583754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459cf40-0db4-4755-b49e-bfa4a07e0a55 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:34.595117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459cf40-0db4-4755-b49e-bfa4a07e0a55 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:34.600251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eda7bb-5633-407e-af9f-e47fbac1ad8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:34.600251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eda7bb-5633-407e-af9f-e47fbac1ad8b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:34.600504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eda7bb-5633-407e-af9f-e47fbac1ad8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:34.600683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eda7bb-5633-407e-af9f-e47fbac1ad8b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:34.601515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eda7bb-5633-407e-af9f-e47fbac1ad8b admin admin] RBAC: Adding query filter params (role.id=4784162e8bd0416c9bc4ef9e01acb1d9, scope.project.id=0a888473e9774db39941b0610769505a, user.id=8df6e02fde834883aef230f31d6ecd94) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:34.601818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eda7bb-5633-407e-af9f-e47fbac1ad8b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:34.603680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eda7bb-5633-407e-af9f-e47fbac1ad8b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:34.609373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 572/1142] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:03:34 2021] GET /identity/v3/role_assignments?user.id=8df6e02fde834883aef230f31d6ecd94&scope.project.id=0a888473e9774db39941b0610769505a&role.id=4784162e8bd0416c9bc4ef9e01acb1d9 => generated 608 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:03:36.915054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd82152-fdf1-4d76-8a7d-cfb434abe9b8 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:36.915610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd82152-fdf1-4d76-8a7d-cfb434abe9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:36.915610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd82152-fdf1-4d76-8a7d-cfb434abe9b8 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:36.917468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 571/1143] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:36 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:36.923433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503ae3-8a06-4642-938d-e8af0ee7d748 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:36.923854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503ae3-8a06-4642-938d-e8af0ee7d748 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:36.923980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47503ae3-8a06-4642-938d-e8af0ee7d748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:36.941449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-47503ae3-8a06-4642-938d-e8af0ee7d748 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:36.942681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-47503ae3-8a06-4642-938d-e8af0ee7d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:36.950991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 573/1144] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:36 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:36.975258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd82152-fdf1-4d76-8a7d-cfb434abe9b8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:36.987199 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd82152-fdf1-4d76-8a7d-cfb434abe9b8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:36.991634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e274a-b41f-4d17-9bff-9d1848a7f238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:36.992400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e274a-b41f-4d17-9bff-9d1848a7f238 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:36.992676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e274a-b41f-4d17-9bff-9d1848a7f238 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:36.992944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e274a-b41f-4d17-9bff-9d1848a7f238 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.003738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e274a-b41f-4d17-9bff-9d1848a7f238 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:03:37.011412 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-2c0e274a-b41f-4d17-9bff-9d1848a7f238 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:03:37.012561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 572/1145] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:03:36 2021] GET /identity/v3/roles/admin => generated 83 bytes in 38 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:37.019493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503ae3-8a06-4642-938d-e8af0ee7d748 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.029531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47503ae3-8a06-4642-938d-e8af0ee7d748 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.034359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44419b-a191-4981-91ab-b81a3f74eab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.035008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44419b-a191-4981-91ab-b81a3f74eab1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.035284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44419b-a191-4981-91ab-b81a3f74eab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.035551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44419b-a191-4981-91ab-b81a3f74eab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.036300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44419b-a191-4981-91ab-b81a3f74eab1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:37.036597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44419b-a191-4981-91ab-b81a3f74eab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.038279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44419b-a191-4981-91ab-b81a3f74eab1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.047450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 574/1146] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:37.053934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e274a-b41f-4d17-9bff-9d1848a7f238 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.065841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e274a-b41f-4d17-9bff-9d1848a7f238 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.070282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452c4e3-c8c6-453e-b934-73adc6457bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.071042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c4e3-c8c6-453e-b934-73adc6457bae admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.071317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c4e3-c8c6-453e-b934-73adc6457bae admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.071583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452c4e3-c8c6-453e-b934-73adc6457bae admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.081804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452c4e3-c8c6-453e-b934-73adc6457bae admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.083646 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452c4e3-c8c6-453e-b934-73adc6457bae admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.099923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-4452c4e3-c8c6-453e-b934-73adc6457bae admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:37.101086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 573/1147] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:37.108128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44419b-a191-4981-91ab-b81a3f74eab1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.117681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44419b-a191-4981-91ab-b81a3f74eab1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.122763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33295505-8c02-43b9-a03d-5909735e5245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.123393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295505-8c02-43b9-a03d-5909735e5245 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.123669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295505-8c02-43b9-a03d-5909735e5245 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.123935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33295505-8c02-43b9-a03d-5909735e5245 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.124648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295505-8c02-43b9-a03d-5909735e5245 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:37.124942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295505-8c02-43b9-a03d-5909735e5245 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.126518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33295505-8c02-43b9-a03d-5909735e5245 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.137780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 575/1148] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:37.144144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452c4e3-c8c6-453e-b934-73adc6457bae admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.153744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452c4e3-c8c6-453e-b934-73adc6457bae admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.158268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc0e33-8da2-4e20-925e-719274acc15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.159031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc0e33-8da2-4e20-925e-719274acc15f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.159303 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc0e33-8da2-4e20-925e-719274acc15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.159569 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc0e33-8da2-4e20-925e-719274acc15f admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.167260 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc0e33-8da2-4e20-925e-719274acc15f admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.169283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc0e33-8da2-4e20-925e-719274acc15f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.183725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-a2dc0e33-8da2-4e20-925e-719274acc15f admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:03:37.184824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 574/1149] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:37.191180 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33295505-8c02-43b9-a03d-5909735e5245 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.200870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33295505-8c02-43b9-a03d-5909735e5245 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.205413 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935502a-a780-48c7-96d3-d1049e9ad868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.206108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935502a-a780-48c7-96d3-d1049e9ad868 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.206386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935502a-a780-48c7-96d3-d1049e9ad868 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.206655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935502a-a780-48c7-96d3-d1049e9ad868 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.207485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935502a-a780-48c7-96d3-d1049e9ad868 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:37.207785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935502a-a780-48c7-96d3-d1049e9ad868 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.209556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935502a-a780-48c7-96d3-d1049e9ad868 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.226225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 576/1150] 10.222.0.32 () {56 vars in 1164 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:37.233551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc0e33-8da2-4e20-925e-719274acc15f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.243143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc0e33-8da2-4e20-925e-719274acc15f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.248283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7000e-904a-453c-a17d-827890cb922d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.248902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7000e-904a-453c-a17d-827890cb922d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.249179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7000e-904a-453c-a17d-827890cb922d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.249449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7000e-904a-453c-a17d-827890cb922d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.257094 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7000e-904a-453c-a17d-827890cb922d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.260238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7000e-904a-453c-a17d-827890cb922d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.267707 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 575/1151] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:03:37.276238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935502a-a780-48c7-96d3-d1049e9ad868 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.285816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935502a-a780-48c7-96d3-d1049e9ad868 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.290326 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f32bf-5254-48eb-bbce-c94edf09eba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.294812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f32bf-5254-48eb-bbce-c94edf09eba9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.294812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f32bf-5254-48eb-bbce-c94edf09eba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.294812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9f32bf-5254-48eb-bbce-c94edf09eba9 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.302395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f32bf-5254-48eb-bbce-c94edf09eba9 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.304215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9f32bf-5254-48eb-bbce-c94edf09eba9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.320750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-6c9f32bf-5254-48eb-bbce-c94edf09eba9 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:37.321856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 577/1152] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:37.328339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7000e-904a-453c-a17d-827890cb922d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.337024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7000e-904a-453c-a17d-827890cb922d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.341765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf5da-7821-4a15-8993-1c877e3c258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.342442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf5da-7821-4a15-8993-1c877e3c258b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.342717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf5da-7821-4a15-8993-1c877e3c258b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.342984 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ddf5da-7821-4a15-8993-1c877e3c258b admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.343699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf5da-7821-4a15-8993-1c877e3c258b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:37.343999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf5da-7821-4a15-8993-1c877e3c258b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.345558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ddf5da-7821-4a15-8993-1c877e3c258b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.357276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 576/1153] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:37.363771 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f32bf-5254-48eb-bbce-c94edf09eba9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.374378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9f32bf-5254-48eb-bbce-c94edf09eba9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.378874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307d8c5-bdcd-46d7-907f-7ddcbc6d2b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.379629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307d8c5-bdcd-46d7-907f-7ddcbc6d2b1b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.379899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307d8c5-bdcd-46d7-907f-7ddcbc6d2b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.380159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5307d8c5-bdcd-46d7-907f-7ddcbc6d2b1b admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.386914 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307d8c5-bdcd-46d7-907f-7ddcbc6d2b1b admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.388848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5307d8c5-bdcd-46d7-907f-7ddcbc6d2b1b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.402235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-5307d8c5-bdcd-46d7-907f-7ddcbc6d2b1b admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:03:37.403331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 578/1154] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:37.409626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf5da-7821-4a15-8993-1c877e3c258b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.425084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ddf5da-7821-4a15-8993-1c877e3c258b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.425084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f2c50-cddb-4e05-bfd7-51532ceb9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.425084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f2c50-cddb-4e05-bfd7-51532ceb9602 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.425411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f2c50-cddb-4e05-bfd7-51532ceb9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.425617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f2c50-cddb-4e05-bfd7-51532ceb9602 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.426438 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f2c50-cddb-4e05-bfd7-51532ceb9602 admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:37.426742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f2c50-cddb-4e05-bfd7-51532ceb9602 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.428546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f2c50-cddb-4e05-bfd7-51532ceb9602 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.440528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 577/1155] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:37.447029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307d8c5-bdcd-46d7-907f-7ddcbc6d2b1b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:37.457598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5307d8c5-bdcd-46d7-907f-7ddcbc6d2b1b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:37.461981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d8a35f-a64a-46fe-8d94-f31537f94120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:37.462685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8a35f-a64a-46fe-8d94-f31537f94120 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:37.463807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8a35f-a64a-46fe-8d94-f31537f94120 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:37.464077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d8a35f-a64a-46fe-8d94-f31537f94120 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:37.464893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8a35f-a64a-46fe-8d94-f31537f94120 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=0a888473e9774db39941b0610769505a, user.id=8df6e02fde834883aef230f31d6ecd94) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:37.465198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8a35f-a64a-46fe-8d94-f31537f94120 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:37.467012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d8a35f-a64a-46fe-8d94-f31537f94120 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:37.472408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 579/1156] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:03:37 2021] GET /identity/v3/role_assignments?user.id=8df6e02fde834883aef230f31d6ecd94&scope.project.id=0a888473e9774db39941b0610769505a&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 259 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:03:39.734259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183aff4-1dfc-486b-acdc-db2f593dddb5 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:39.734828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183aff4-1dfc-486b-acdc-db2f593dddb5 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:39.734828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183aff4-1dfc-486b-acdc-db2f593dddb5 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:39.736563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 578/1157] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:39.742582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa9c13-b4e5-4052-b700-3f914ce50882 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:39.742985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa9c13-b4e5-4052-b700-3f914ce50882 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:39.743125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa9c13-b4e5-4052-b700-3f914ce50882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:39.760367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0daa9c13-b4e5-4052-b700-3f914ce50882 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:39.761547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0daa9c13-b4e5-4052-b700-3f914ce50882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:39.769426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 580/1158] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:39 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:39.793897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183aff4-1dfc-486b-acdc-db2f593dddb5 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:39.806476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183aff4-1dfc-486b-acdc-db2f593dddb5 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:39.810741 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e10c1-7529-4e77-9857-cdfb80f450df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:39.811504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e10c1-7529-4e77-9857-cdfb80f450df admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:39.811785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e10c1-7529-4e77-9857-cdfb80f450df admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:39.812054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85e10c1-7529-4e77-9857-cdfb80f450df admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:39.821829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85e10c1-7529-4e77-9857-cdfb80f450df admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:03:39.828948 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-e85e10c1-7529-4e77-9857-cdfb80f450df admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:03:39.830077 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 579/1159] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:03:39 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:39.836447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa9c13-b4e5-4052-b700-3f914ce50882 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:39.845804 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa9c13-b4e5-4052-b700-3f914ce50882 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:39.850350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e327e9-c145-483f-85f8-510b032437a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:39.850990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e327e9-c145-483f-85f8-510b032437a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:39.851270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e327e9-c145-483f-85f8-510b032437a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:39.851540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e327e9-c145-483f-85f8-510b032437a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:39.852286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e327e9-c145-483f-85f8-510b032437a1 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:39.852587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e327e9-c145-483f-85f8-510b032437a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:39.854831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e327e9-c145-483f-85f8-510b032437a1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:39.862926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 581/1160] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:03:39 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:39.868993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e10c1-7529-4e77-9857-cdfb80f450df admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:39.878852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85e10c1-7529-4e77-9857-cdfb80f450df admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:39.883273 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095e4e0-1a21-432d-9bae-07bc73d46626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:39.884018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095e4e0-1a21-432d-9bae-07bc73d46626 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:39.884291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095e4e0-1a21-432d-9bae-07bc73d46626 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:39.884557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095e4e0-1a21-432d-9bae-07bc73d46626 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:39.895034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095e4e0-1a21-432d-9bae-07bc73d46626 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:39.896919 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095e4e0-1a21-432d-9bae-07bc73d46626 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:39.913635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-b095e4e0-1a21-432d-9bae-07bc73d46626 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:39.914946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 580/1161] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:39 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:39.921926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e327e9-c145-483f-85f8-510b032437a1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:39.931602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e327e9-c145-483f-85f8-510b032437a1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:39.936349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0297b-169d-4ad4-ae72-01e5ede61942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:39.940715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0297b-169d-4ad4-ae72-01e5ede61942 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:39.940715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0297b-169d-4ad4-ae72-01e5ede61942 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:39.940715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b0297b-169d-4ad4-ae72-01e5ede61942 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:39.940715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0297b-169d-4ad4-ae72-01e5ede61942 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:39.940715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0297b-169d-4ad4-ae72-01e5ede61942 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:39.940715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b0297b-169d-4ad4-ae72-01e5ede61942 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:39.951571 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 582/1162] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:39.957716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095e4e0-1a21-432d-9bae-07bc73d46626 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:39.967805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095e4e0-1a21-432d-9bae-07bc73d46626 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:39.972209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c713d7-8826-480a-bf82-b91f642cea23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:39.972967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c713d7-8826-480a-bf82-b91f642cea23 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:39.973241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c713d7-8826-480a-bf82-b91f642cea23 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:39.973506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c713d7-8826-480a-bf82-b91f642cea23 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:39.981281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c713d7-8826-480a-bf82-b91f642cea23 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:39.983294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c713d7-8826-480a-bf82-b91f642cea23 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:39.997221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-64c713d7-8826-480a-bf82-b91f642cea23 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:03:39.998326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 581/1163] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:39 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:40.004586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0297b-169d-4ad4-ae72-01e5ede61942 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:40.014753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b0297b-169d-4ad4-ae72-01e5ede61942 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:40.019872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ede127-d476-44aa-9328-5c14d406dce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:40.020520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ede127-d476-44aa-9328-5c14d406dce4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:40.020795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ede127-d476-44aa-9328-5c14d406dce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:40.021062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ede127-d476-44aa-9328-5c14d406dce4 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:40.021989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ede127-d476-44aa-9328-5c14d406dce4 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:40.022323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ede127-d476-44aa-9328-5c14d406dce4 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:40.024113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ede127-d476-44aa-9328-5c14d406dce4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:40.041352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 583/1164] 10.222.0.32 () {56 vars in 1164 bytes} [Wed Oct 27 01:03:40 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:40.047524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c713d7-8826-480a-bf82-b91f642cea23 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:40.057157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c713d7-8826-480a-bf82-b91f642cea23 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:40.061536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aebeb-c639-4d18-8d5b-115a7e946f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:40.062327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aebeb-c639-4d18-8d5b-115a7e946f71 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:40.062603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aebeb-c639-4d18-8d5b-115a7e946f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:40.062872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8aebeb-c639-4d18-8d5b-115a7e946f71 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:40.073404 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8aebeb-c639-4d18-8d5b-115a7e946f71 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:40.081909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8aebeb-c639-4d18-8d5b-115a7e946f71 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:40.091934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-1d8aebeb-c639-4d18-8d5b-115a7e946f71 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:40.093039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 582/1165] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:40 2021] GET /identity/v3/domains/Default => generated 87 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:40.099456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ede127-d476-44aa-9328-5c14d406dce4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:40.109109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ede127-d476-44aa-9328-5c14d406dce4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:40.113486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb47afa-7e79-4c3e-9e89-35a54574cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:40.114504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb47afa-7e79-4c3e-9e89-35a54574cf39 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:40.114779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb47afa-7e79-4c3e-9e89-35a54574cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:40.115043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb47afa-7e79-4c3e-9e89-35a54574cf39 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:40.115762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb47afa-7e79-4c3e-9e89-35a54574cf39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:40.116059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb47afa-7e79-4c3e-9e89-35a54574cf39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:40.117602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb47afa-7e79-4c3e-9e89-35a54574cf39 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:40.128621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 584/1166] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:40 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:03:40.135266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aebeb-c639-4d18-8d5b-115a7e946f71 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:40.145010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8aebeb-c639-4d18-8d5b-115a7e946f71 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:40.149454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a2513-8fbf-4ff7-a9d3-cd35b83796fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:40.151050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2513-8fbf-4ff7-a9d3-cd35b83796fc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:40.151256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2513-8fbf-4ff7-a9d3-cd35b83796fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:40.151718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514a2513-8fbf-4ff7-a9d3-cd35b83796fc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:40.158362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a2513-8fbf-4ff7-a9d3-cd35b83796fc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:40.160272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514a2513-8fbf-4ff7-a9d3-cd35b83796fc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:40.173031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-514a2513-8fbf-4ff7-a9d3-cd35b83796fc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:03:40.174161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 583/1167] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:03:40 2021] GET /identity/v3/projects/service => generated 88 bytes in 40 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:03:40.180374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb47afa-7e79-4c3e-9e89-35a54574cf39 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:40.189915 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb47afa-7e79-4c3e-9e89-35a54574cf39 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:40.194392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa036fb1-9d89-44ee-b04b-c08ea9e6b5bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:40.196730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa036fb1-9d89-44ee-b04b-c08ea9e6b5bf admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:40.196730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa036fb1-9d89-44ee-b04b-c08ea9e6b5bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:40.196730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa036fb1-9d89-44ee-b04b-c08ea9e6b5bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:40.196730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa036fb1-9d89-44ee-b04b-c08ea9e6b5bf admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:40.196730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa036fb1-9d89-44ee-b04b-c08ea9e6b5bf admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:40.199279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa036fb1-9d89-44ee-b04b-c08ea9e6b5bf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:40.211066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 585/1168] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:03:40 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:03:40.218522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a2513-8fbf-4ff7-a9d3-cd35b83796fc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:40.228565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514a2513-8fbf-4ff7-a9d3-cd35b83796fc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:40.232864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c00f1b8-1af4-4752-a8f4-4785c4a23841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:40.233702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f1b8-1af4-4752-a8f4-4785c4a23841 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:40.233974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f1b8-1af4-4752-a8f4-4785c4a23841 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:40.234271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c00f1b8-1af4-4752-a8f4-4785c4a23841 admin admin] PATH_INFO: `/v3/projects/0a888473e9774db39941b0610769505a/users/8df6e02fde834883aef230f31d6ecd94/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:40.236190 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00f1b8-1af4-4752-a8f4-4785c4a23841 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a888473e9774db39941b0610769505a, user_id=8df6e02fde834883aef230f31d6ecd94, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:40.238814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c00f1b8-1af4-4752-a8f4-4785c4a23841 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:40.292556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 584/1169] 10.222.0.32 () {58 vars in 1460 bytes} [Wed Oct 27 01:03:40 2021] PUT /identity/v3/projects/0a888473e9774db39941b0610769505a/users/8df6e02fde834883aef230f31d6ecd94/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:03:42.550734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9816a02-623a-4df6-b186-54eb1d6222de None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.551262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9816a02-623a-4df6-b186-54eb1d6222de None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.551262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9816a02-623a-4df6-b186-54eb1d6222de None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.553043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 586/1170] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:42 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:42.559020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5005a3-5bfa-40aa-999b-8b2e406faa35 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.559450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5005a3-5bfa-40aa-999b-8b2e406faa35 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.559546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5005a3-5bfa-40aa-999b-8b2e406faa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.576788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8a5005a3-5bfa-40aa-999b-8b2e406faa35 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:42.577948 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8a5005a3-5bfa-40aa-999b-8b2e406faa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:42.633282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 585/1171] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:42 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:42.659018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9816a02-623a-4df6-b186-54eb1d6222de None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:42.671309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9816a02-623a-4df6-b186-54eb1d6222de None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:42.675601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a53272-2998-4d8e-a8b3-af2937917f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:42.676364 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a53272-2998-4d8e-a8b3-af2937917f2e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.676638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a53272-2998-4d8e-a8b3-af2937917f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.676901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a53272-2998-4d8e-a8b3-af2937917f2e admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.687537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a53272-2998-4d8e-a8b3-af2937917f2e admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 27 01:03:42.694217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-f0a53272-2998-4d8e-a8b3-af2937917f2e admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 27 01:03:42.695357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 587/1172] 10.222.0.32 () {56 vars in 1117 bytes} [Wed Oct 27 01:03:42 2021] GET /identity/v3/roles/admin => generated 83 bytes in 37 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:42.702875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5005a3-5bfa-40aa-999b-8b2e406faa35 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:42.711656 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5005a3-5bfa-40aa-999b-8b2e406faa35 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:42.716645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43f37b-dfb5-4bf1-96c4-92fa96831b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:42.717295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43f37b-dfb5-4bf1-96c4-92fa96831b55 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.717572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43f37b-dfb5-4bf1-96c4-92fa96831b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.717843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43f37b-dfb5-4bf1-96c4-92fa96831b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.718632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43f37b-dfb5-4bf1-96c4-92fa96831b55 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:42.718938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43f37b-dfb5-4bf1-96c4-92fa96831b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:42.720579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43f37b-dfb5-4bf1-96c4-92fa96831b55 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:42.728760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 586/1173] 10.222.0.32 () {56 vars in 1120 bytes} [Wed Oct 27 01:03:42 2021] GET /identity/v3/roles?name=admin => generated 339 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:42.735144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a53272-2998-4d8e-a8b3-af2937917f2e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:42.745740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a53272-2998-4d8e-a8b3-af2937917f2e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:42.750194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e572b-a2d4-4d1f-aceb-6ed411226b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:42.750942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e572b-a2d4-4d1f-aceb-6ed411226b90 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.751215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e572b-a2d4-4d1f-aceb-6ed411226b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.751479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e572b-a2d4-4d1f-aceb-6ed411226b90 admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.762168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e572b-a2d4-4d1f-aceb-6ed411226b90 admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:42.764095 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e572b-a2d4-4d1f-aceb-6ed411226b90 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:42.780723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-cd5e572b-a2d4-4d1f-aceb-6ed411226b90 admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:42.782299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 588/1174] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:42.788445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43f37b-dfb5-4bf1-96c4-92fa96831b55 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:42.798085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43f37b-dfb5-4bf1-96c4-92fa96831b55 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:42.802879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61ffbd-f9eb-4a96-ac58-e97f453c043d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:42.803470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61ffbd-f9eb-4a96-ac58-e97f453c043d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.803746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61ffbd-f9eb-4a96-ac58-e97f453c043d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.804014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f61ffbd-f9eb-4a96-ac58-e97f453c043d admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.804724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61ffbd-f9eb-4a96-ac58-e97f453c043d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:42.805019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61ffbd-f9eb-4a96-ac58-e97f453c043d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:42.807278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f61ffbd-f9eb-4a96-ac58-e97f453c043d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:42.819098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 587/1175] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:42.826094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e572b-a2d4-4d1f-aceb-6ed411226b90 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:42.835593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e572b-a2d4-4d1f-aceb-6ed411226b90 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:42.840422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b14df-ca87-418a-8de3-3ad56ed75fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:42.841185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b14df-ca87-418a-8de3-3ad56ed75fd7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.841460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b14df-ca87-418a-8de3-3ad56ed75fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.841728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b14df-ca87-418a-8de3-3ad56ed75fd7 admin admin] PATH_INFO: `/v3/users/placement` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.848900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b14df-ca87-418a-8de3-3ad56ed75fd7 admin admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:42.850910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b14df-ca87-418a-8de3-3ad56ed75fd7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:42.865728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-ec4b14df-ca87-418a-8de3-3ad56ed75fd7 admin admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 27 01:03:42.866867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 589/1176] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:42 2021] GET /identity/v3/users/placement => generated 87 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:42.873565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61ffbd-f9eb-4a96-ac58-e97f453c043d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:42.882989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f61ffbd-f9eb-4a96-ac58-e97f453c043d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:42.888078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0fbde-141f-4672-b4a4-89578380b656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:42.888715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0fbde-141f-4672-b4a4-89578380b656 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.888988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0fbde-141f-4672-b4a4-89578380b656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.896704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0fbde-141f-4672-b4a4-89578380b656 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.896704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0fbde-141f-4672-b4a4-89578380b656 admin admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:42.896704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0fbde-141f-4672-b4a4-89578380b656 admin admin] RBAC: Authorizing `identity:list_users()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:42.896704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0fbde-141f-4672-b4a4-89578380b656 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:42.909351 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 588/1177] 10.222.0.32 () {56 vars in 1164 bytes} [Wed Oct 27 01:03:42 2021] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:42.915434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b14df-ca87-418a-8de3-3ad56ed75fd7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:42.925119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b14df-ca87-418a-8de3-3ad56ed75fd7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:42.929669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64d08-4eb6-417e-ba4d-972f6124f921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:42.930314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64d08-4eb6-417e-ba4d-972f6124f921 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.930591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64d08-4eb6-417e-ba4d-972f6124f921 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.930859 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf64d08-4eb6-417e-ba4d-972f6124f921 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.938998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64d08-4eb6-417e-ba4d-972f6124f921 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:42.940693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf64d08-4eb6-417e-ba4d-972f6124f921 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:42.950251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 590/1178] 10.222.0.32 () {58 vars in 1324 bytes} [Wed Oct 27 01:03:42 2021] GET /identity/v3/auth/tokens => generated 3126 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:03:42.959820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0fbde-141f-4672-b4a4-89578380b656 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:42.966545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0fbde-141f-4672-b4a4-89578380b656 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:42.970991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab94eb0-6afc-4e97-86c6-a02086dec9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:42.971758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab94eb0-6afc-4e97-86c6-a02086dec9dd admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:42.972036 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab94eb0-6afc-4e97-86c6-a02086dec9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:42.972309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab94eb0-6afc-4e97-86c6-a02086dec9dd admin admin] PATH_INFO: `/v3/domains/Default` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:42.982284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab94eb0-6afc-4e97-86c6-a02086dec9dd admin admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:42.984158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab94eb0-6afc-4e97-86c6-a02086dec9dd admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:43.001816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-8ab94eb0-6afc-4e97-86c6-a02086dec9dd admin admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 27 01:03:43.003000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 589/1179] 10.222.0.32 () {56 vars in 1129 bytes} [Wed Oct 27 01:03:42 2021] GET /identity/v3/domains/Default => generated 87 bytes in 47 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:43.010537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64d08-4eb6-417e-ba4d-972f6124f921 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:43.019716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf64d08-4eb6-417e-ba4d-972f6124f921 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:43.024332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e6e73-5a36-42b6-a271-1ff089f7b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:43.024970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e6e73-5a36-42b6-a271-1ff089f7b3c8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:43.025400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e6e73-5a36-42b6-a271-1ff089f7b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:43.025564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e6e73-5a36-42b6-a271-1ff089f7b3c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:43.026321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e6e73-5a36-42b6-a271-1ff089f7b3c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:43.026624 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e6e73-5a36-42b6-a271-1ff089f7b3c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:43.028171 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e6e73-5a36-42b6-a271-1ff089f7b3c8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:43.039042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 591/1180] 10.222.0.32 () {56 vars in 1130 bytes} [Wed Oct 27 01:03:43 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:43.047695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab94eb0-6afc-4e97-86c6-a02086dec9dd admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:43.057949 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab94eb0-6afc-4e97-86c6-a02086dec9dd admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:43.062280 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19c44c-84e0-4316-a58c-a69f431ad5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:43.063080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c44c-84e0-4316-a58c-a69f431ad5dc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:43.063354 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c44c-84e0-4316-a58c-a69f431ad5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:43.063620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c44c-84e0-4316-a58c-a69f431ad5dc admin admin] PATH_INFO: `/v3/projects/service` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:43.070170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19c44c-84e0-4316-a58c-a69f431ad5dc admin admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:43.072566 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19c44c-84e0-4316-a58c-a69f431ad5dc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:43.084995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING keystone.server.flask.application [None req-de19c44c-84e0-4316-a58c-a69f431ad5dc admin admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 27 01:03:43.086098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 590/1181] 10.222.0.32 () {56 vars in 1132 bytes} [Wed Oct 27 01:03:43 2021] GET /identity/v3/projects/service => generated 88 bytes in 39 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:43.092837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e6e73-5a36-42b6-a271-1ff089f7b3c8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:43.102332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e6e73-5a36-42b6-a271-1ff089f7b3c8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:43.107608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7e256-9420-41e2-9a18-dc43f138b9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:43.108241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e256-9420-41e2-9a18-dc43f138b9db admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:43.108522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e256-9420-41e2-9a18-dc43f138b9db admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:43.108794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7e256-9420-41e2-9a18-dc43f138b9db admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:43.109581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7e256-9420-41e2-9a18-dc43f138b9db admin admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:43.109885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7e256-9420-41e2-9a18-dc43f138b9db admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:43.111731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7e256-9420-41e2-9a18-dc43f138b9db admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:43.124401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 592/1182] 10.222.0.32 () {56 vars in 1169 bytes} [Wed Oct 27 01:03:43 2021] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:43.130667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19c44c-84e0-4316-a58c-a69f431ad5dc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:43.140792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19c44c-84e0-4316-a58c-a69f431ad5dc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:43.145519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a3505-6d8b-4af5-9f4b-4097e57249b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:43.146174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a3505-6d8b-4af5-9f4b-4097e57249b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:43.146451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a3505-6d8b-4af5-9f4b-4097e57249b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:43.152606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a3505-6d8b-4af5-9f4b-4097e57249b4 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:43.152606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a3505-6d8b-4af5-9f4b-4097e57249b4 admin admin] RBAC: Adding query filter params (role.id=ace9f50cac674ba897bcc0c7a470e7bb, scope.project.id=0a888473e9774db39941b0610769505a, user.id=8df6e02fde834883aef230f31d6ecd94) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:43.152606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a3505-6d8b-4af5-9f4b-4097e57249b4 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:43.152606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a3505-6d8b-4af5-9f4b-4097e57249b4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:43.155245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 591/1183] 10.222.0.32 () {56 vars in 1395 bytes} [Wed Oct 27 01:03:43 2021] GET /identity/v3/role_assignments?user.id=8df6e02fde834883aef230f31d6ecd94&scope.project.id=0a888473e9774db39941b0610769505a&role.id=ace9f50cac674ba897bcc0c7a470e7bb => generated 608 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:45.393970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9edb91-4a21-4693-ad3d-15a8dd509b49 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:45.394501 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9edb91-4a21-4693-ad3d-15a8dd509b49 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:45.394659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9edb91-4a21-4693-ad3d-15a8dd509b49 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:45.396478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 593/1184] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:45.402948 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c452efd-6db9-4bdb-9e32-01a370488c04 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:45.403418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c452efd-6db9-4bdb-9e32-01a370488c04 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:45.403529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c452efd-6db9-4bdb-9e32-01a370488c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:45.421024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4c452efd-6db9-4bdb-9e32-01a370488c04 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:45.422230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4c452efd-6db9-4bdb-9e32-01a370488c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:45.429897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 592/1185] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:45 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:45.453948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9edb91-4a21-4693-ad3d-15a8dd509b49 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:45.466008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9edb91-4a21-4693-ad3d-15a8dd509b49 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:45.470547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1007ca-1677-4058-ae26-fb24c5a67465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:45.471375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1007ca-1677-4058-ae26-fb24c5a67465 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:45.471656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1007ca-1677-4058-ae26-fb24c5a67465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:45.471923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1007ca-1677-4058-ae26-fb24c5a67465 admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:45.472585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1007ca-1677-4058-ae26-fb24c5a67465 admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:45.474194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1007ca-1677-4058-ae26-fb24c5a67465 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:45.485554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-0c1007ca-1677-4058-ae26-fb24c5a67465 admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:03:45.486699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 594/1186] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:03:45 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:45.493319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c452efd-6db9-4bdb-9e32-01a370488c04 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:45.503143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c452efd-6db9-4bdb-9e32-01a370488c04 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:45.507595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40662345-56cb-4a59-ab05-f32ddccce465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:45.508237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40662345-56cb-4a59-ab05-f32ddccce465 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:45.508553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40662345-56cb-4a59-ab05-f32ddccce465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:45.508800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40662345-56cb-4a59-ab05-f32ddccce465 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:45.509495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40662345-56cb-4a59-ab05-f32ddccce465 admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:45.509797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40662345-56cb-4a59-ab05-f32ddccce465 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:45.511462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40662345-56cb-4a59-ab05-f32ddccce465 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:45.516111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 593/1187] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Oct 27 01:03:45 2021] GET /identity/v3/services?name=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:45.522667 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1007ca-1677-4058-ae26-fb24c5a67465 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:45.531997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1007ca-1677-4058-ae26-fb24c5a67465 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:45.536361 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0913f5-8518-4ec0-b7e4-671d2a368246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:45.539715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0913f5-8518-4ec0-b7e4-671d2a368246 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:45.539715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0913f5-8518-4ec0-b7e4-671d2a368246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:45.539715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0913f5-8518-4ec0-b7e4-671d2a368246 admin admin] PATH_INFO: `/v3/services` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:45.539715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0913f5-8518-4ec0-b7e4-671d2a368246 admin admin] RBAC: Adding query filter params (type=placement) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:45.539715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0913f5-8518-4ec0-b7e4-671d2a368246 admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:45.540099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0913f5-8518-4ec0-b7e4-671d2a368246 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:45.544949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 595/1188] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Oct 27 01:03:45 2021] GET /identity/v3/services?type=placement => generated 126 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:47.814081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545fe9e-451d-4cfd-9a17-d63fd3b98ca4 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:47.814645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545fe9e-451d-4cfd-9a17-d63fd3b98ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:47.814645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545fe9e-451d-4cfd-9a17-d63fd3b98ca4 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:47.816448 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 594/1189] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:47.822912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479abb4e-554e-4e35-8f78-a385a1ea9465 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:47.824318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479abb4e-554e-4e35-8f78-a385a1ea9465 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:47.824318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479abb4e-554e-4e35-8f78-a385a1ea9465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:47.842070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-479abb4e-554e-4e35-8f78-a385a1ea9465 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:47.843232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-479abb4e-554e-4e35-8f78-a385a1ea9465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:47.850743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 596/1190] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:47 2021] POST /identity/v3/auth/tokens => generated 3126 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:03:47.874781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545fe9e-451d-4cfd-9a17-d63fd3b98ca4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:47.887375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545fe9e-451d-4cfd-9a17-d63fd3b98ca4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:47.891859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a86dc4-006d-43f5-909c-c948b2eaed17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:47.892488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a86dc4-006d-43f5-909c-c948b2eaed17 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:47.892761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a86dc4-006d-43f5-909c-c948b2eaed17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:47.893027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a86dc4-006d-43f5-909c-c948b2eaed17 admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:47.893749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a86dc4-006d-43f5-909c-c948b2eaed17 admin admin] RBAC: Authorizing `identity:create_service()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:47.895334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a86dc4-006d-43f5-909c-c948b2eaed17 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:47.990775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 595/1191] 10.222.0.32 () {60 vars in 1162 bytes} [Wed Oct 27 01:03:47 2021] POST /identity/v3/services => generated 246 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:03:50.243626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07ca3-0b54-4a8c-8727-f215b3fd81cb None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:50.244686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07ca3-0b54-4a8c-8727-f215b3fd81cb None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:50.244686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e07ca3-0b54-4a8c-8727-f215b3fd81cb None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:50.246493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 597/1192] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:50 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:50.256778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814e5b8-e0c8-473b-827a-8a68492842b6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:50.256778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814e5b8-e0c8-473b-827a-8a68492842b6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:50.256778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c814e5b8-e0c8-473b-827a-8a68492842b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:50.283200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c814e5b8-e0c8-473b-827a-8a68492842b6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:50.284390 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c814e5b8-e0c8-473b-827a-8a68492842b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:50.301692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 596/1193] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:50 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:50.326821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e07ca3-0b54-4a8c-8727-f215b3fd81cb None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:50.339652 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e07ca3-0b54-4a8c-8727-f215b3fd81cb None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:50.343977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57982fbc-dba9-4ee3-85ff-3d02950ae14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:50.344739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57982fbc-dba9-4ee3-85ff-3d02950ae14b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:50.345011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57982fbc-dba9-4ee3-85ff-3d02950ae14b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:50.345276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57982fbc-dba9-4ee3-85ff-3d02950ae14b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:50.345932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57982fbc-dba9-4ee3-85ff-3d02950ae14b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:50.347515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57982fbc-dba9-4ee3-85ff-3d02950ae14b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:50.358363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-57982fbc-dba9-4ee3-85ff-3d02950ae14b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:03:50.359779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 598/1194] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:03:50 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 27 01:03:50.366439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814e5b8-e0c8-473b-827a-8a68492842b6 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:50.376456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c814e5b8-e0c8-473b-827a-8a68492842b6 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:50.381265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67695db7-e7f4-42ac-8602-2020fbebfb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:50.381939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67695db7-e7f4-42ac-8602-2020fbebfb8c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:50.382279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67695db7-e7f4-42ac-8602-2020fbebfb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:50.382610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67695db7-e7f4-42ac-8602-2020fbebfb8c admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:50.383398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67695db7-e7f4-42ac-8602-2020fbebfb8c admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:50.383701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67695db7-e7f4-42ac-8602-2020fbebfb8c admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:50.386431 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67695db7-e7f4-42ac-8602-2020fbebfb8c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:50.392286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 597/1195] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Oct 27 01:03:50 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:50.398965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57982fbc-dba9-4ee3-85ff-3d02950ae14b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:50.409050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57982fbc-dba9-4ee3-85ff-3d02950ae14b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:50.413771 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbc0b99-e44b-45f5-a275-db65266c44af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:50.416390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc0b99-e44b-45f5-a275-db65266c44af admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:50.416390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc0b99-e44b-45f5-a275-db65266c44af admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:50.416390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbc0b99-e44b-45f5-a275-db65266c44af admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:50.416390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc0b99-e44b-45f5-a275-db65266c44af admin admin] RBAC: Adding query filter params (interface=public, service_id=11869fe32b5c405899952a13afc10901, region_id=RegionOne) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:50.416871 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc0b99-e44b-45f5-a275-db65266c44af admin admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:50.418298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbc0b99-e44b-45f5-a275-db65266c44af admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:50.423443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 599/1196] 10.222.0.32 () {56 vars in 1272 bytes} [Wed Oct 27 01:03:50 2021] GET /identity/v3/endpoints?service_id=11869fe32b5c405899952a13afc10901&interface=public®ion_id=RegionOne => generated 194 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:50.429693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67695db7-e7f4-42ac-8602-2020fbebfb8c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:50.440174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67695db7-e7f4-42ac-8602-2020fbebfb8c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:50.444784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f5068-ce2f-4a02-be02-d00b2e4f70eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:50.445453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f5068-ce2f-4a02-be02-d00b2e4f70eb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:50.445743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f5068-ce2f-4a02-be02-d00b2e4f70eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:50.446081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f5068-ce2f-4a02-be02-d00b2e4f70eb admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:50.446766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f5068-ce2f-4a02-be02-d00b2e4f70eb admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:50.448645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f5068-ce2f-4a02-be02-d00b2e4f70eb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:50.455633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 598/1197] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:03:50 2021] GET /identity/v3/services => generated 2191 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:03:52.804901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286460d-a8cc-4e7e-83d1-44f51b88a0ff None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:52.805458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286460d-a8cc-4e7e-83d1-44f51b88a0ff None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:52.805458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2286460d-a8cc-4e7e-83d1-44f51b88a0ff None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:52.807353 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 600/1198] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:03:52 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:03:52.813111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc21a0f-ecb5-4674-928d-4a4eace9c669 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:52.814349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc21a0f-ecb5-4674-928d-4a4eace9c669 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:52.814349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc21a0f-ecb5-4674-928d-4a4eace9c669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:52.832213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-7bc21a0f-ecb5-4674-928d-4a4eace9c669 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:03:52.833380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7bc21a0f-ecb5-4674-928d-4a4eace9c669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:03:52.841598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 599/1199] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:03:52 2021] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:03:52.865583 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286460d-a8cc-4e7e-83d1-44f51b88a0ff None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:52.877738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2286460d-a8cc-4e7e-83d1-44f51b88a0ff None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:52.882208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f39f3-b505-4dcf-a539-9d86110b953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:52.882966 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f39f3-b505-4dcf-a539-9d86110b953b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:52.883236 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f39f3-b505-4dcf-a539-9d86110b953b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:52.883499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f39f3-b505-4dcf-a539-9d86110b953b admin admin] PATH_INFO: `/v3/services/placement` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:52.884152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f39f3-b505-4dcf-a539-9d86110b953b admin admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:52.886474 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740f39f3-b505-4dcf-a539-9d86110b953b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:52.897477 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING keystone.server.flask.application [None req-740f39f3-b505-4dcf-a539-9d86110b953b admin admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 27 01:03:52.898585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 601/1200] 10.222.0.32 () {56 vars in 1138 bytes} [Wed Oct 27 01:03:52 2021] GET /identity/v3/services/placement => generated 90 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 27 01:03:52.906142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc21a0f-ecb5-4674-928d-4a4eace9c669 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:52.915030 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc21a0f-ecb5-4674-928d-4a4eace9c669 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:52.923366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e11d2-2518-4ed3-b63a-b56d645758aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:52.923986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e11d2-2518-4ed3-b63a-b56d645758aa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:52.924256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e11d2-2518-4ed3-b63a-b56d645758aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:52.924521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e11d2-2518-4ed3-b63a-b56d645758aa admin admin] PATH_INFO: `/v3/services` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:52.925219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e11d2-2518-4ed3-b63a-b56d645758aa admin admin] RBAC: Adding query filter params (name=placement) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:03:52.925517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e11d2-2518-4ed3-b63a-b56d645758aa admin admin] RBAC: Authorizing `identity:list_services()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:52.927206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e11d2-2518-4ed3-b63a-b56d645758aa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:52.932334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 600/1201] 10.222.0.32 () {56 vars in 1137 bytes} [Wed Oct 27 01:03:52 2021] GET /identity/v3/services?name=placement => generated 358 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:03:52.938716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f39f3-b505-4dcf-a539-9d86110b953b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:03:52.949786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740f39f3-b505-4dcf-a539-9d86110b953b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:03:52.954296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78ed73f-9e78-4319-b18d-83ad37ce060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:03:52.954924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ed73f-9e78-4319-b18d-83ad37ce060e admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:03:52.955197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ed73f-9e78-4319-b18d-83ad37ce060e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:03:52.955464 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78ed73f-9e78-4319-b18d-83ad37ce060e admin admin] PATH_INFO: `/v3/endpoints` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:03:52.956195 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ed73f-9e78-4319-b18d-83ad37ce060e admin admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:03:52.957729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78ed73f-9e78-4319-b18d-83ad37ce060e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:03:53.031377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 602/1202] 10.222.0.32 () {60 vars in 1165 bytes} [Wed Oct 27 01:03:52 2021] POST /identity/v3/endpoints => generated 331 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:10:57.306247 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87bd28-b200-4cce-a133-84ac066fac57 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:57.312493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87bd28-b200-4cce-a133-84ac066fac57 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:57.312493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87bd28-b200-4cce-a133-84ac066fac57 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:57.312493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 601/1203] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:10:57 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:10:57.315918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8ba10-89c5-45e4-89a6-9876656501bf None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:57.316803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8ba10-89c5-45e4-89a6-9876656501bf None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:57.317225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f8ba10-89c5-45e4-89a6-9876656501bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:57.596670 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c8f8ba10-89c5-45e4-89a6-9876656501bf None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:10:57.598318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c8f8ba10-89c5-45e4-89a6-9876656501bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:57.771199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 603/1204] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:10:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:10:57.795684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87bd28-b200-4cce-a133-84ac066fac57 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:10:57.797603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9a87bd28-b200-4cce-a133-84ac066fac57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:10:57.926778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87bd28-b200-4cce-a133-84ac066fac57 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:10:58.043093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cf057b-295a-4a85-a9e7-725f41a0d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:10:58.043937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf057b-295a-4a85-a9e7-725f41a0d3de admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:10:58.044310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf057b-295a-4a85-a9e7-725f41a0d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:10:58.044680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cf057b-295a-4a85-a9e7-725f41a0d3de admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:10:58.045519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf057b-295a-4a85-a9e7-725f41a0d3de admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:10:58.047615 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cf057b-295a-4a85-a9e7-725f41a0d3de admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:10:58.068613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 602/1205] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:10:57 2021] GET /identity/v3/projects => generated 2553 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:11:00.429227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a42555-a666-421c-bd34-87ce02479067 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.429767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a42555-a666-421c-bd34-87ce02479067 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.429767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a42555-a666-421c-bd34-87ce02479067 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.431586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 604/1206] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:00.437770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7570f94-0b88-4dad-995d-831fc18cf2a3 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.438224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7570f94-0b88-4dad-995d-831fc18cf2a3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.438339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7570f94-0b88-4dad-995d-831fc18cf2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.506473 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e7570f94-0b88-4dad-995d-831fc18cf2a3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:00.507661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e7570f94-0b88-4dad-995d-831fc18cf2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:00.603871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 603/1207] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:00.655976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb425-3bbe-4eb0-9052-f891b0678ebe None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.656258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb425-3bbe-4eb0-9052-f891b0678ebe None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.656532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bb425-3bbe-4eb0-9052-f891b0678ebe None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.658350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 605/1208] 10.222.0.32 () {54 vars in 964 bytes} [Wed Oct 27 01:11:00 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:00.664300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79814f-d1b1-49ba-a421-ee644d5bbb60 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.664579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79814f-d1b1-49ba-a421-ee644d5bbb60 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.664850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79814f-d1b1-49ba-a421-ee644d5bbb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.735738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-3c79814f-d1b1-49ba-a421-ee644d5bbb60 None None] MFA Rules not processed for user `66c74b04afed4aabbdbee054438a4933`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:00.736846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3c79814f-d1b1-49ba-a421-ee644d5bbb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:00.809235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 604/1209] 10.222.0.32 () {58 vars in 1061 bytes} [Wed Oct 27 01:11:00 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:00.818445 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bb425-3bbe-4eb0-9052-f891b0678ebe None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:00.819943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-092bb425-3bbe-4eb0-9052-f891b0678ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:00.917551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bb425-3bbe-4eb0-9052-f891b0678ebe None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:00.985538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d0b8c-ca60-46bd-81b0-b110880cacae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:00.986262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d0b8c-ca60-46bd-81b0-b110880cacae service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:00.986481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d0b8c-ca60-46bd-81b0-b110880cacae service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:00.986742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d0b8c-ca60-46bd-81b0-b110880cacae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:00.988345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-043d0b8c-ca60-46bd-81b0-b110880cacae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:01.093880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d0b8c-ca60-46bd-81b0-b110880cacae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:01.095329 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d0b8c-ca60-46bd-81b0-b110880cacae service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:01.112800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 606/1210] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:11:03.634793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff142d1-d9dd-4e10-823f-c6c41758010f None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.635321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff142d1-d9dd-4e10-823f-c6c41758010f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.635321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff142d1-d9dd-4e10-823f-c6c41758010f None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.637314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 605/1211] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:03.643234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44c2f-1240-4ff4-bed3-27e3b6285aa7 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.643683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44c2f-1240-4ff4-bed3-27e3b6285aa7 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.643778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d44c2f-1240-4ff4-bed3-27e3b6285aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.704512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-08d44c2f-1240-4ff4-bed3-27e3b6285aa7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:03.705685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-08d44c2f-1240-4ff4-bed3-27e3b6285aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:03.797950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 607/1212] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:03.852621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30208d0-1bb8-4d91-874b-6366060aa021 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.852899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30208d0-1bb8-4d91-874b-6366060aa021 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.853174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30208d0-1bb8-4d91-874b-6366060aa021 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.855520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 606/1213] 10.222.0.32 () {54 vars in 964 bytes} [Wed Oct 27 01:11:03 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:03.861787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a9bbd-f8ed-4001-89d0-98fe1f85850f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:03.862172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a9bbd-f8ed-4001-89d0-98fe1f85850f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:03.862448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a9bbd-f8ed-4001-89d0-98fe1f85850f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:03.933960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-b18a9bbd-f8ed-4001-89d0-98fe1f85850f None None] MFA Rules not processed for user `66c74b04afed4aabbdbee054438a4933`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:03.935152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b18a9bbd-f8ed-4001-89d0-98fe1f85850f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:04.005962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 608/1214] 10.222.0.32 () {58 vars in 1061 bytes} [Wed Oct 27 01:11:03 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:04.015509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30208d0-1bb8-4d91-874b-6366060aa021 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:04.017007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e30208d0-1bb8-4d91-874b-6366060aa021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:04.114272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30208d0-1bb8-4d91-874b-6366060aa021 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:04.184776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e19c1-ee7c-49d8-a47c-01b835e5a355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:04.185336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e19c1-ee7c-49d8-a47c-01b835e5a355 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:04.185606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e19c1-ee7c-49d8-a47c-01b835e5a355 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:04.185870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e19c1-ee7c-49d8-a47c-01b835e5a355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:04.187495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-377e19c1-ee7c-49d8-a47c-01b835e5a355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:04.289954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e19c1-ee7c-49d8-a47c-01b835e5a355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:04.291389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e19c1-ee7c-49d8-a47c-01b835e5a355 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:04.309011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 607/1215] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:07.299704 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a75b41-f8df-4cb4-ba79-cf5fb6bd858f None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:07.300208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a75b41-f8df-4cb4-ba79-cf5fb6bd858f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:07.300208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a75b41-f8df-4cb4-ba79-cf5fb6bd858f None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:07.301928 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 609/1216] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:07 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:07.308123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8350-c4e1-4e05-94c2-adc2778e951d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:07.308734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8350-c4e1-4e05-94c2-adc2778e951d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:07.308734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8350-c4e1-4e05-94c2-adc2778e951d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:07.370726 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-adce8350-c4e1-4e05-94c2-adc2778e951d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:07.372097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-adce8350-c4e1-4e05-94c2-adc2778e951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:07.465590 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 608/1217] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:07.512096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a75b41-f8df-4cb4-ba79-cf5fb6bd858f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:07.514998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d9a75b41-f8df-4cb4-ba79-cf5fb6bd858f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:07.633335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a75b41-f8df-4cb4-ba79-cf5fb6bd858f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:07.719908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34c92dc-7230-4673-9ce7-9a64fb1310ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:07.720742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c92dc-7230-4673-9ce7-9a64fb1310ab admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:07.721011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c92dc-7230-4673-9ce7-9a64fb1310ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:07.721274 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34c92dc-7230-4673-9ce7-9a64fb1310ab admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:07.730508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c92dc-7230-4673-9ce7-9a64fb1310ab admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:07.732516 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34c92dc-7230-4673-9ce7-9a64fb1310ab admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:07.734191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 610/1218] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:11:07 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:07.747515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce8350-c4e1-4e05-94c2-adc2778e951d None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:07.748732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-adce8350-c4e1-4e05-94c2-adc2778e951d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:07.834414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce8350-c4e1-4e05-94c2-adc2778e951d None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:07.904113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d0ac9-9592-46eb-8dd7-cd49cd78071b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:07.904743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d0ac9-9592-46eb-8dd7-cd49cd78071b service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:07.905019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d0ac9-9592-46eb-8dd7-cd49cd78071b service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:07.905286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d0ac9-9592-46eb-8dd7-cd49cd78071b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:07.906919 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8e0d0ac9-9592-46eb-8dd7-cd49cd78071b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:08.009377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d0ac9-9592-46eb-8dd7-cd49cd78071b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:08.010836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d0ac9-9592-46eb-8dd7-cd49cd78071b service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:08.028938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 609/1219] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:11:11.129725 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c154f-6e71-4ee5-a5e4-3d879b59244f None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:11.130340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c154f-6e71-4ee5-a5e4-3d879b59244f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:11.130340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c154f-6e71-4ee5-a5e4-3d879b59244f None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:11.132077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 611/1220] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:11.138275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77f66-6ee9-49ff-a727-301e6b5f2ab6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:11.138667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77f66-6ee9-49ff-a727-301e6b5f2ab6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:11.138820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac77f66-6ee9-49ff-a727-301e6b5f2ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:11.201374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-dac77f66-6ee9-49ff-a727-301e6b5f2ab6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:11.202699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-dac77f66-6ee9-49ff-a727-301e6b5f2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:11.293501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 610/1221] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:11.329963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c154f-6e71-4ee5-a5e4-3d879b59244f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:11.331615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-914c154f-6e71-4ee5-a5e4-3d879b59244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:11.449311 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c154f-6e71-4ee5-a5e4-3d879b59244f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:11.536756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3918624-0159-449f-9e86-041bd4673f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:11.537593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3918624-0159-449f-9e86-041bd4673f0a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:11.537863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3918624-0159-449f-9e86-041bd4673f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:11.538155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3918624-0159-449f-9e86-041bd4673f0a admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:11.548039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3918624-0159-449f-9e86-041bd4673f0a admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:11.549979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3918624-0159-449f-9e86-041bd4673f0a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:11.551676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 612/1222] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:11:11 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:11.564275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac77f66-6ee9-49ff-a727-301e6b5f2ab6 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:11.565460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-dac77f66-6ee9-49ff-a727-301e6b5f2ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:11.650932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac77f66-6ee9-49ff-a727-301e6b5f2ab6 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:11.720804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25819b-6784-4a31-8d06-53a9a54c4ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:11.721444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25819b-6784-4a31-8d06-53a9a54c4ddf service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:11.721718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25819b-6784-4a31-8d06-53a9a54c4ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:11.721983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25819b-6784-4a31-8d06-53a9a54c4ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:11.723747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-df25819b-6784-4a31-8d06-53a9a54c4ddf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:11.826339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25819b-6784-4a31-8d06-53a9a54c4ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:11.827690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25819b-6784-4a31-8d06-53a9a54c4ddf service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:11.845278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 611/1223] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:15.321682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ca8f-6b97-432b-a8fe-9165fec55c6f None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:15.321682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ca8f-6b97-432b-a8fe-9165fec55c6f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:15.321682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72ca8f-6b97-432b-a8fe-9165fec55c6f None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:15.321682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 613/1224] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:15.327177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ea2d-6a95-4bfb-95cf-c7566ee81006 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:15.327658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ea2d-6a95-4bfb-95cf-c7566ee81006 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:15.327784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ea2d-6a95-4bfb-95cf-c7566ee81006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:15.398319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-45a6ea2d-6a95-4bfb-95cf-c7566ee81006 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:15.399523 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-45a6ea2d-6a95-4bfb-95cf-c7566ee81006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:15.498660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 612/1225] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:11:15.538000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72ca8f-6b97-432b-a8fe-9165fec55c6f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:15.539601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5e72ca8f-6b97-432b-a8fe-9165fec55c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:15.639046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e72ca8f-6b97-432b-a8fe-9165fec55c6f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:15.707929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62db5b-96da-4687-b8c3-feb1fb17b4c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:15.708489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62db5b-96da-4687-b8c3-feb1fb17b4c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:15.708761 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62db5b-96da-4687-b8c3-feb1fb17b4c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:15.709033 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62db5b-96da-4687-b8c3-feb1fb17b4c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:15.710666 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ae62db5b-96da-4687-b8c3-feb1fb17b4c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:15.814779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62db5b-96da-4687-b8c3-feb1fb17b4c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:15.816204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62db5b-96da-4687-b8c3-feb1fb17b4c0 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:15.833475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 614/1226] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:18.173733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e7e75-193e-48c8-83c1-6a3dc863953d None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.174388 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e7e75-193e-48c8-83c1-6a3dc863953d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.174388 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8e7e75-193e-48c8-83c1-6a3dc863953d None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.176215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 613/1227] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:18 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:18.182071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a101-304d-4f00-af55-99f500e7468f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.182590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a101-304d-4f00-af55-99f500e7468f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.182685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658a101-304d-4f00-af55-99f500e7468f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.245491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e658a101-304d-4f00-af55-99f500e7468f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:18.246606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e658a101-304d-4f00-af55-99f500e7468f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:18.338446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 615/1228] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:18.377063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e7e75-193e-48c8-83c1-6a3dc863953d None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:18.378733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3d8e7e75-193e-48c8-83c1-6a3dc863953d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:18.478331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8e7e75-193e-48c8-83c1-6a3dc863953d None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:18.552622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73990a3f-cae9-4286-89d4-8e3dfba68b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:18.553191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990a3f-cae9-4286-89d4-8e3dfba68b09 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:18.553470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990a3f-cae9-4286-89d4-8e3dfba68b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:18.553747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73990a3f-cae9-4286-89d4-8e3dfba68b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:18.555432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-73990a3f-cae9-4286-89d4-8e3dfba68b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:18.669817 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73990a3f-cae9-4286-89d4-8e3dfba68b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:18.671317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73990a3f-cae9-4286-89d4-8e3dfba68b09 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:18.690600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 614/1229] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:21.012580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060f582-2092-4526-b371-9f59d7a89f99 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:21.013006 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060f582-2092-4526-b371-9f59d7a89f99 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:21.013154 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060f582-2092-4526-b371-9f59d7a89f99 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:21.014986 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 616/1230] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:21 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:21.020933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571de6-a531-41d0-aa50-22e7759db505 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:21.021368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571de6-a531-41d0-aa50-22e7759db505 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:21.021468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e571de6-a531-41d0-aa50-22e7759db505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:21.083846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8e571de6-a531-41d0-aa50-22e7759db505 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:21.085041 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8e571de6-a531-41d0-aa50-22e7759db505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:21.183582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 615/1231] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:21.217264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060f582-2092-4526-b371-9f59d7a89f99 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:21.218921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4060f582-2092-4526-b371-9f59d7a89f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:21.337852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060f582-2092-4526-b371-9f59d7a89f99 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:21.428139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0576b9-23e2-4de5-a053-d700c3c2fad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:21.428979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0576b9-23e2-4de5-a053-d700c3c2fad8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:21.429252 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0576b9-23e2-4de5-a053-d700c3c2fad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:21.429521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0576b9-23e2-4de5-a053-d700c3c2fad8 admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:21.439895 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0576b9-23e2-4de5-a053-d700c3c2fad8 admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:21.441957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0576b9-23e2-4de5-a053-d700c3c2fad8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:21.443774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 617/1232] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:11:21 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:11:21.456876 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571de6-a531-41d0-aa50-22e7759db505 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:21.458191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8e571de6-a531-41d0-aa50-22e7759db505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:21.547025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e571de6-a531-41d0-aa50-22e7759db505 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:21.621800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e951a-fb4a-4abe-93bd-49c95495d57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:21.622393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e951a-fb4a-4abe-93bd-49c95495d57d service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:21.622663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e951a-fb4a-4abe-93bd-49c95495d57d service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:21.622930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e951a-fb4a-4abe-93bd-49c95495d57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:21.624555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-456e951a-fb4a-4abe-93bd-49c95495d57d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:21.731388 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e951a-fb4a-4abe-93bd-49c95495d57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:21.732812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456e951a-fb4a-4abe-93bd-49c95495d57d service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:21.750762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 616/1233] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:24.666555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117999-d15b-4824-bfb9-a008c132cd7d None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.667115 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117999-d15b-4824-bfb9-a008c132cd7d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.667115 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117999-d15b-4824-bfb9-a008c132cd7d None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.668853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 618/1234] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:24 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:24.674869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e88235-66f6-4ad9-987a-b246ce0c7787 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:24.675305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e88235-66f6-4ad9-987a-b246ce0c7787 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:24.675425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e88235-66f6-4ad9-987a-b246ce0c7787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:24.738885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-50e88235-66f6-4ad9-987a-b246ce0c7787 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:24.740075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-50e88235-66f6-4ad9-987a-b246ce0c7787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:24.834057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 617/1235] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:24.872449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65117999-d15b-4824-bfb9-a008c132cd7d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:24.873945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-65117999-d15b-4824-bfb9-a008c132cd7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:24.974654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65117999-d15b-4824-bfb9-a008c132cd7d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:25.044291 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2505ef1-0f6a-41bf-80f4-45b549eaf7f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:25.044930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2505ef1-0f6a-41bf-80f4-45b549eaf7f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:25.045207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2505ef1-0f6a-41bf-80f4-45b549eaf7f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:25.045484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2505ef1-0f6a-41bf-80f4-45b549eaf7f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:25.047128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f2505ef1-0f6a-41bf-80f4-45b549eaf7f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:25.149606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2505ef1-0f6a-41bf-80f4-45b549eaf7f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:25.151078 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2505ef1-0f6a-41bf-80f4-45b549eaf7f6 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:25.169537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 619/1236] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:27.515038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f94e8-c0a0-4aef-960a-fe5d8013108c None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.515573 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f94e8-c0a0-4aef-960a-fe5d8013108c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.515668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053f94e8-c0a0-4aef-960a-fe5d8013108c None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.517467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 618/1237] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:27.523662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442ab05-4b36-4d7e-b3dc-436a5eec8bbf None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.524101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442ab05-4b36-4d7e-b3dc-436a5eec8bbf None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.524216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a442ab05-4b36-4d7e-b3dc-436a5eec8bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.592133 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-a442ab05-4b36-4d7e-b3dc-436a5eec8bbf None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:27.593325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a442ab05-4b36-4d7e-b3dc-436a5eec8bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:27.691230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 620/1238] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:11:27.733739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f94e8-c0a0-4aef-960a-fe5d8013108c None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:27.735294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-053f94e8-c0a0-4aef-960a-fe5d8013108c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:27.834956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053f94e8-c0a0-4aef-960a-fe5d8013108c None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:27.904733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645537d4-5bbb-47b3-9c7f-76bc35929d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:27.905369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645537d4-5bbb-47b3-9c7f-76bc35929d62 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:27.905649 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645537d4-5bbb-47b3-9c7f-76bc35929d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:27.905920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645537d4-5bbb-47b3-9c7f-76bc35929d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:27.907697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-645537d4-5bbb-47b3-9c7f-76bc35929d62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:27.919753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645537d4-5bbb-47b3-9c7f-76bc35929d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:27.921157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645537d4-5bbb-47b3-9c7f-76bc35929d62 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:27.941402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 619/1239] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:30.991164 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8efa-a64a-4e1e-8e81-a37ef4d44227 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.991717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8efa-a64a-4e1e-8e81-a37ef4d44227 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.991717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f8efa-a64a-4e1e-8e81-a37ef4d44227 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:30.993464 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 621/1240] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:30 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:30.999422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c227cd6-0f65-462f-915c-f43a0dcc8fe9 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:30.999838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c227cd6-0f65-462f-915c-f43a0dcc8fe9 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:30.999994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c227cd6-0f65-462f-915c-f43a0dcc8fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:31.017014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8c227cd6-0f65-462f-915c-f43a0dcc8fe9 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:31.018232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8c227cd6-0f65-462f-915c-f43a0dcc8fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:31.025761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 620/1241] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:30 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:31.065271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f8efa-a64a-4e1e-8e81-a37ef4d44227 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:31.067182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-fa7f8efa-a64a-4e1e-8e81-a37ef4d44227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:31.100883 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f8efa-a64a-4e1e-8e81-a37ef4d44227 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:31.105126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb59065-9eff-4e93-9fcc-a510df8507bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:31.105790 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb59065-9eff-4e93-9fcc-a510df8507bf service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:31.106144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb59065-9eff-4e93-9fcc-a510df8507bf service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:31.106418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb59065-9eff-4e93-9fcc-a510df8507bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:31.115208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb59065-9eff-4e93-9fcc-a510df8507bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:31.116614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb59065-9eff-4e93-9fcc-a510df8507bf service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:31.126001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 622/1242] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:35.658346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9a0f9-5804-435b-b419-66a47b938810 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.658846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9a0f9-5804-435b-b419-66a47b938810 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.658846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b9a0f9-5804-435b-b419-66a47b938810 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.660581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 621/1243] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:35 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:35.666653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b01f-f688-4853-84e3-bf6480b6f45d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.667090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b01f-f688-4853-84e3-bf6480b6f45d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.667331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59b01f-f688-4853-84e3-bf6480b6f45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.685524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-de59b01f-f688-4853-84e3-bf6480b6f45d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:35.686756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-de59b01f-f688-4853-84e3-bf6480b6f45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:35.694532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 623/1244] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:35.736050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9a0f9-5804-435b-b419-66a47b938810 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:35.747099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b9a0f9-5804-435b-b419-66a47b938810 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:35.750578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2c3f82-75b2-454d-a964-a5f028d030b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:35.751196 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c3f82-75b2-454d-a964-a5f028d030b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:35.751468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c3f82-75b2-454d-a964-a5f028d030b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:35.751734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2c3f82-75b2-454d-a964-a5f028d030b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:35.761237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c3f82-75b2-454d-a964-a5f028d030b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:35.762682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2c3f82-75b2-454d-a964-a5f028d030b0 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:35.771773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 622/1245] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:35 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:39.118905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c16a-1f2c-4f61-b8b5-6cc25f665543 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.119484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c16a-1f2c-4f61-b8b5-6cc25f665543 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.119484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1c16a-1f2c-4f61-b8b5-6cc25f665543 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.121283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 624/1246] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:39.127289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c856c2-d805-4363-8420-9344aabba08d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.127693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c856c2-d805-4363-8420-9344aabba08d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.127956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c856c2-d805-4363-8420-9344aabba08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.146543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-08c856c2-d805-4363-8420-9344aabba08d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:39.147816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-08c856c2-d805-4363-8420-9344aabba08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:39.156085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 623/1247] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:39.195124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c16a-1f2c-4f61-b8b5-6cc25f665543 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:39.206529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1c16a-1f2c-4f61-b8b5-6cc25f665543 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:39.210163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db0a6c0-acbe-478f-a7aa-fdf8a5690e23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:39.210822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a6c0-acbe-478f-a7aa-fdf8a5690e23 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:39.211098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a6c0-acbe-478f-a7aa-fdf8a5690e23 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:39.211368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db0a6c0-acbe-478f-a7aa-fdf8a5690e23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:39.221335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0a6c0-acbe-478f-a7aa-fdf8a5690e23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:39.222822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db0a6c0-acbe-478f-a7aa-fdf8a5690e23 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:39.233287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 625/1248] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:43.948311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e1d6-70fb-4787-867e-70e032592118 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:43.948782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e1d6-70fb-4787-867e-70e032592118 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:43.948872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e1d6-70fb-4787-867e-70e032592118 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:43.950661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 624/1249] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:43.956700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8eaa-f96c-4013-936c-d0abbed34069 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:43.957162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8eaa-f96c-4013-936c-d0abbed34069 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:43.957270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8eaa-f96c-4013-936c-d0abbed34069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:43.975125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0f3b8eaa-f96c-4013-936c-d0abbed34069 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:43.976309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0f3b8eaa-f96c-4013-936c-d0abbed34069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:43.985093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 626/1250] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:44.027154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e1d6-70fb-4787-867e-70e032592118 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:44.037044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e1d6-70fb-4787-867e-70e032592118 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:44.040607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c694b2-412f-4e5b-9166-f5430134ee2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:44.041494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c694b2-412f-4e5b-9166-f5430134ee2c service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:44.041863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c694b2-412f-4e5b-9166-f5430134ee2c service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:44.042175 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c694b2-412f-4e5b-9166-f5430134ee2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:44.050844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c694b2-412f-4e5b-9166-f5430134ee2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:44.052258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c694b2-412f-4e5b-9166-f5430134ee2c service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:44.061408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 625/1251] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:11:49.256553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63cff-5133-44a1-b30f-e22dff513f9d None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:49.257090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63cff-5133-44a1-b30f-e22dff513f9d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:49.257090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f63cff-5133-44a1-b30f-e22dff513f9d None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:49.258811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 627/1252] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:11:49 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:49.265162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ad340-3f23-4571-8a23-f98d39007ab4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:49.265951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ad340-3f23-4571-8a23-f98d39007ab4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:49.266437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ad340-3f23-4571-8a23-f98d39007ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:49.344224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5c2ad340-3f23-4571-8a23-f98d39007ab4 None None] MFA Rules not processed for user `8df6e02fde834883aef230f31d6ecd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:49.345735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5c2ad340-3f23-4571-8a23-f98d39007ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:49.428599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 626/1253] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:11:49 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:53.588328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67295672-a796-4228-8146-4bf40be1ebee None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.589213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67295672-a796-4228-8146-4bf40be1ebee None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.589528 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67295672-a796-4228-8146-4bf40be1ebee None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.591741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 628/1254] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:11:53 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:53.597271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3c30b-56ac-4b07-9171-fe78d3aa4c24 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:53.598048 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3c30b-56ac-4b07-9171-fe78d3aa4c24 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:53.598331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b3c30b-56ac-4b07-9171-fe78d3aa4c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:53.616866 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-79b3c30b-56ac-4b07-9171-fe78d3aa4c24 None None] MFA Rules not processed for user `8df6e02fde834883aef230f31d6ecd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:53.618055 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-79b3c30b-56ac-4b07-9171-fe78d3aa4c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:53.626710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 627/1255] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:11:53 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:55.168482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78204bb1-1cbe-48e5-9e8f-36102443a740 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:55.169012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78204bb1-1cbe-48e5-9e8f-36102443a740 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:55.169161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78204bb1-1cbe-48e5-9e8f-36102443a740 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:55.170913 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 629/1256] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:11:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:55.176415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6640096-a8ea-4c9f-9588-e0ab0b864dca None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:55.176833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6640096-a8ea-4c9f-9588-e0ab0b864dca None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:55.177116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6640096-a8ea-4c9f-9588-e0ab0b864dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:55.195144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d6640096-a8ea-4c9f-9588-e0ab0b864dca None None] MFA Rules not processed for user `8df6e02fde834883aef230f31d6ecd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:55.196347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d6640096-a8ea-4c9f-9588-e0ab0b864dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:55.205201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 628/1257] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:11:55 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:59.178323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c3ba0-d321-42f5-8dcd-1ed7b1589ff0 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.178805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c3ba0-d321-42f5-8dcd-1ed7b1589ff0 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.178926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c3ba0-d321-42f5-8dcd-1ed7b1589ff0 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.180760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 630/1258] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:11:59 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:59.187111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051c72c-5201-467e-93b3-1ee16ccaaff7 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.187522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051c72c-5201-467e-93b3-1ee16ccaaff7 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.187652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4051c72c-5201-467e-93b3-1ee16ccaaff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.205152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4051c72c-5201-467e-93b3-1ee16ccaaff7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:59.206346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4051c72c-5201-467e-93b3-1ee16ccaaff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:59.217736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 629/1259] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:11:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:59.265618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af5eb-0089-4f8b-9c53-2c8f06690bdf None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.266057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af5eb-0089-4f8b-9c53-2c8f06690bdf None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.266566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0af5eb-0089-4f8b-9c53-2c8f06690bdf None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.268450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 631/1260] 10.222.0.32 () {54 vars in 960 bytes} [Wed Oct 27 01:11:59 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:11:59.274099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5f75-0614-4ea5-8f21-64ca265d6f34 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.274386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5f75-0614-4ea5-8f21-64ca265d6f34 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.274693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f5f75-0614-4ea5-8f21-64ca265d6f34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.325147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ed2f5f75-0614-4ea5-8f21-64ca265d6f34 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:11:59.326351 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ed2f5f75-0614-4ea5-8f21-64ca265d6f34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:11:59.412461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 630/1261] 10.222.0.32 () {58 vars in 1057 bytes} [Wed Oct 27 01:11:59 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:11:59.420743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0af5eb-0089-4f8b-9c53-2c8f06690bdf None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:11:59.441415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0af5eb-0089-4f8b-9c53-2c8f06690bdf None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:11:59.448356 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f90415-ebde-4008-a4b8-d45699010942 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:11:59.449315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f90415-ebde-4008-a4b8-d45699010942 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:11:59.449796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f90415-ebde-4008-a4b8-d45699010942 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:11:59.450607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f90415-ebde-4008-a4b8-d45699010942 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:11:59.459939 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f90415-ebde-4008-a4b8-d45699010942 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:11:59.462075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f90415-ebde-4008-a4b8-d45699010942 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:11:59.473983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 632/1262] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:11:59 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:01.967064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff3013-2229-4bae-b703-bd8083b7600a None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.967626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff3013-2229-4bae-b703-bd8083b7600a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.967626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ff3013-2229-4bae-b703-bd8083b7600a None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.969359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 631/1263] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:01.975450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3f47-123d-4611-a389-e31b1591764a None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:01.975865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3f47-123d-4611-a389-e31b1591764a None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:01.975998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d3f47-123d-4611-a389-e31b1591764a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:01.996484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-254d3f47-123d-4611-a389-e31b1591764a None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:01.997880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-254d3f47-123d-4611-a389-e31b1591764a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:02.006625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 633/1264] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:02.053901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff3013-2229-4bae-b703-bd8083b7600a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:02.068051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ff3013-2229-4bae-b703-bd8083b7600a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:02.074525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf3458a-dccc-433c-a3f2-e4ea73f5af5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:02.075221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3458a-dccc-433c-a3f2-e4ea73f5af5c service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:02.075570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3458a-dccc-433c-a3f2-e4ea73f5af5c service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:02.075912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf3458a-dccc-433c-a3f2-e4ea73f5af5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:02.084660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3458a-dccc-433c-a3f2-e4ea73f5af5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:02.086364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf3458a-dccc-433c-a3f2-e4ea73f5af5c service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:02.096417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 632/1265] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:02 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:04.918517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b04ae-9a6c-4f04-b900-30a85666aa81 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.919054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b04ae-9a6c-4f04-b900-30a85666aa81 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.919054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b04ae-9a6c-4f04-b900-30a85666aa81 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.920838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 634/1266] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:04.927122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a654-0173-4e45-8046-c290f21a35e3 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:04.927625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a654-0173-4e45-8046-c290f21a35e3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:04.927705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811a654-0173-4e45-8046-c290f21a35e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:04.949952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c811a654-0173-4e45-8046-c290f21a35e3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:04.951250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c811a654-0173-4e45-8046-c290f21a35e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:04.960818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 633/1267] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:05.009608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f7aed-91b7-4c8b-8612-7ff50166c00f None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.009895 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f7aed-91b7-4c8b-8612-7ff50166c00f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.010216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966f7aed-91b7-4c8b-8612-7ff50166c00f None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.011984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 635/1268] 10.222.0.32 () {54 vars in 960 bytes} [Wed Oct 27 01:12:05 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:05.018348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0de7b-ddd5-4756-b6f5-1171440aaff8 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.018893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0de7b-ddd5-4756-b6f5-1171440aaff8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.019394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0de7b-ddd5-4756-b6f5-1171440aaff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.040541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8cf0de7b-ddd5-4756-b6f5-1171440aaff8 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:05.041994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8cf0de7b-ddd5-4756-b6f5-1171440aaff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:05.051474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 634/1269] 10.222.0.32 () {58 vars in 1057 bytes} [Wed Oct 27 01:12:05 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:12:05.060145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f7aed-91b7-4c8b-8612-7ff50166c00f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:05.076819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966f7aed-91b7-4c8b-8612-7ff50166c00f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:05.082894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f3aa2-1efe-4cb8-b617-23e539b7e3f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:05.083550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f3aa2-1efe-4cb8-b617-23e539b7e3f9 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:05.083813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f3aa2-1efe-4cb8-b617-23e539b7e3f9 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:05.084089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f3aa2-1efe-4cb8-b617-23e539b7e3f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:05.093550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f3aa2-1efe-4cb8-b617-23e539b7e3f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:05.095509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f3aa2-1efe-4cb8-b617-23e539b7e3f9 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:05.112949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 636/1270] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:05 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:07.155690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964063df-df7c-4f7a-9343-c22268a82e2a None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.156677 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964063df-df7c-4f7a-9343-c22268a82e2a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.157168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964063df-df7c-4f7a-9343-c22268a82e2a None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.159513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 635/1271] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:07.165957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589a5bd-9618-4f2f-bb4c-2cf3c5d12426 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.166446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589a5bd-9618-4f2f-bb4c-2cf3c5d12426 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.166527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589a5bd-9618-4f2f-bb4c-2cf3c5d12426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.187153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d589a5bd-9618-4f2f-bb4c-2cf3c5d12426 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:07.188497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d589a5bd-9618-4f2f-bb4c-2cf3c5d12426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:07.197554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 637/1272] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:07.257363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38fd0a-fff5-4c47-9e2a-b952910d4310 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.257574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38fd0a-fff5-4c47-9e2a-b952910d4310 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.257797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c38fd0a-fff5-4c47-9e2a-b952910d4310 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.260754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 636/1273] 10.222.0.32 () {54 vars in 962 bytes} [Wed Oct 27 01:12:07 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:07.266719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a389c6-056c-47ff-a7bc-3363206bc250 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.267048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a389c6-056c-47ff-a7bc-3363206bc250 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.267267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a389c6-056c-47ff-a7bc-3363206bc250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.315945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-51a389c6-056c-47ff-a7bc-3363206bc250 None None] MFA Rules not processed for user `6d490db0d91a4426930130a4f83f7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:07.317123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-51a389c6-056c-47ff-a7bc-3363206bc250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:07.391172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 638/1274] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Oct 27 01:12:07 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:07.399120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38fd0a-fff5-4c47-9e2a-b952910d4310 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:07.410519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c38fd0a-fff5-4c47-9e2a-b952910d4310 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:07.414001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3befac-0a26-4fb9-9b90-d13f2d311bb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:07.414664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3befac-0a26-4fb9-9b90-d13f2d311bb2 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.414978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3befac-0a26-4fb9-9b90-d13f2d311bb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.415386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3befac-0a26-4fb9-9b90-d13f2d311bb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.425097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3befac-0a26-4fb9-9b90-d13f2d311bb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:07.426572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3befac-0a26-4fb9-9b90-d13f2d311bb2 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:07.436681 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 637/1275] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:07.639013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71559f-d763-4e81-92f6-70ec2e679193 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.639276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71559f-d763-4e81-92f6-70ec2e679193 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.639784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f71559f-d763-4e81-92f6-70ec2e679193 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.641551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 639/1276] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:07.647757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0af722-c000-4976-a000-8d430f4e5887 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.648179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0af722-c000-4976-a000-8d430f4e5887 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.648462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0af722-c000-4976-a000-8d430f4e5887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.671480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-df0af722-c000-4976-a000-8d430f4e5887 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:07.672791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-df0af722-c000-4976-a000-8d430f4e5887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:07.683464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 638/1277] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:07.730748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71559f-d763-4e81-92f6-70ec2e679193 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:07.746109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f71559f-d763-4e81-92f6-70ec2e679193 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:07.752137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e3bdd3-ed84-43bd-b0cb-7699f5ef3b3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:07.753246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3bdd3-ed84-43bd-b0cb-7699f5ef3b3a service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:07.753729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3bdd3-ed84-43bd-b0cb-7699f5ef3b3a service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:07.754220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e3bdd3-ed84-43bd-b0cb-7699f5ef3b3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:07.763648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3bdd3-ed84-43bd-b0cb-7699f5ef3b3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:07.765580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e3bdd3-ed84-43bd-b0cb-7699f5ef3b3a service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:07.783474 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 640/1278] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:10.251076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513abad-cc2d-428c-88cd-65c2844c9881 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:10.251558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513abad-cc2d-428c-88cd-65c2844c9881 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:10.251558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513abad-cc2d-428c-88cd-65c2844c9881 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:10.253588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 639/1279] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:10.260475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054762e6-33e7-458d-bf11-4f053a7e74ac None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:10.260903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054762e6-33e7-458d-bf11-4f053a7e74ac None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:10.261013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054762e6-33e7-458d-bf11-4f053a7e74ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:10.279002 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-054762e6-33e7-458d-bf11-4f053a7e74ac None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:10.280178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-054762e6-33e7-458d-bf11-4f053a7e74ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:10.288170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 641/1280] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:10.339206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513abad-cc2d-428c-88cd-65c2844c9881 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:10.355102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513abad-cc2d-428c-88cd-65c2844c9881 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:10.360688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f7ef7b-bea6-494a-b48a-7ab49c45cb7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:10.361407 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7ef7b-bea6-494a-b48a-7ab49c45cb7c service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:10.361857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7ef7b-bea6-494a-b48a-7ab49c45cb7c service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:10.362229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f7ef7b-bea6-494a-b48a-7ab49c45cb7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:10.370619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7ef7b-bea6-494a-b48a-7ab49c45cb7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:10.372187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f7ef7b-bea6-494a-b48a-7ab49c45cb7c service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:10.381579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 640/1281] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:12.873280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6497f-304b-480d-8446-58d7adc6416b None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.873812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6497f-304b-480d-8446-58d7adc6416b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.873812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6497f-304b-480d-8446-58d7adc6416b None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.875676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 642/1282] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:12.883164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119fa8-c57d-49ba-952b-e5638f9f6393 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.884648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119fa8-c57d-49ba-952b-e5638f9f6393 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.884926 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c119fa8-c57d-49ba-952b-e5638f9f6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:12.904593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-0c119fa8-c57d-49ba-952b-e5638f9f6393 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:12.905809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0c119fa8-c57d-49ba-952b-e5638f9f6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:12.914155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 641/1283] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:12.961181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6497f-304b-480d-8446-58d7adc6416b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:12.976113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6497f-304b-480d-8446-58d7adc6416b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:12.981987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567e650-9c4f-42b1-8e7b-c3fe8fa04cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:12.986615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567e650-9c4f-42b1-8e7b-c3fe8fa04cc7 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:12.986976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567e650-9c4f-42b1-8e7b-c3fe8fa04cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:12.987323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567e650-9c4f-42b1-8e7b-c3fe8fa04cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:13.000076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567e650-9c4f-42b1-8e7b-c3fe8fa04cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:13.001898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2567e650-9c4f-42b1-8e7b-c3fe8fa04cc7 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:13.013442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 643/1284] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:15.500044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c8a2-1349-49d8-906f-5837bcad1103 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.500580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c8a2-1349-49d8-906f-5837bcad1103 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.500580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf05c8a2-1349-49d8-906f-5837bcad1103 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.502791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 642/1285] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:15.509431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a6050-048f-44e1-8a32-13e921e3dc96 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.510012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a6050-048f-44e1-8a32-13e921e3dc96 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.510012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65a6050-048f-44e1-8a32-13e921e3dc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.532524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f65a6050-048f-44e1-8a32-13e921e3dc96 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:15.534280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f65a6050-048f-44e1-8a32-13e921e3dc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:15.544936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 644/1286] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:12:15.591483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c8a2-1349-49d8-906f-5837bcad1103 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:15.606249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf05c8a2-1349-49d8-906f-5837bcad1103 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:15.611782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc4d48f-dc0a-4926-a653-561ee31f3a73 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:15.612438 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4d48f-dc0a-4926-a653-561ee31f3a73 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:15.612729 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4d48f-dc0a-4926-a653-561ee31f3a73 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:15.613009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc4d48f-dc0a-4926-a653-561ee31f3a73 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:15.622953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4d48f-dc0a-4926-a653-561ee31f3a73 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:15.624592 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc4d48f-dc0a-4926-a653-561ee31f3a73 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:15.634353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 643/1287] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:17.880492 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9a930-58f1-4ad9-97a5-5621f7e4206c None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:17.881066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9a930-58f1-4ad9-97a5-5621f7e4206c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:17.881066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9a930-58f1-4ad9-97a5-5621f7e4206c None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:17.882835 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 645/1288] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:17.888991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3deb8-e8ab-4601-97f5-0ff8f2384a67 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:17.889513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3deb8-e8ab-4601-97f5-0ff8f2384a67 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:17.889605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3deb8-e8ab-4601-97f5-0ff8f2384a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:17.907873 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c9d3deb8-e8ab-4601-97f5-0ff8f2384a67 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:17.909112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c9d3deb8-e8ab-4601-97f5-0ff8f2384a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:17.918043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 644/1289] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:12:17.964471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9a930-58f1-4ad9-97a5-5621f7e4206c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:17.979359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9a930-58f1-4ad9-97a5-5621f7e4206c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:17.984903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46772d9f-a0ea-4c5c-ac35-4fd4e6121aa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:17.985539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46772d9f-a0ea-4c5c-ac35-4fd4e6121aa3 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:17.985816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46772d9f-a0ea-4c5c-ac35-4fd4e6121aa3 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:17.986122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46772d9f-a0ea-4c5c-ac35-4fd4e6121aa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:17.996065 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46772d9f-a0ea-4c5c-ac35-4fd4e6121aa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:17.998175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46772d9f-a0ea-4c5c-ac35-4fd4e6121aa3 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:18.011846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 646/1290] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:20.967044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bda34-13e7-4788-afea-18cb12303a75 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:20.967653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bda34-13e7-4788-afea-18cb12303a75 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:20.967653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836bda34-13e7-4788-afea-18cb12303a75 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:20.969360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 645/1291] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:20.975701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be2869-7b17-4087-8843-f84de549000f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:20.976280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be2869-7b17-4087-8843-f84de549000f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:20.976280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11be2869-7b17-4087-8843-f84de549000f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:20.997752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-11be2869-7b17-4087-8843-f84de549000f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:20.998968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-11be2869-7b17-4087-8843-f84de549000f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:21.006987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 647/1292] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:21.060360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bda34-13e7-4788-afea-18cb12303a75 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:21.075480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836bda34-13e7-4788-afea-18cb12303a75 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:21.081406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71da1a-217e-4c63-9c82-cdf26442c457 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:21.082063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71da1a-217e-4c63-9c82-cdf26442c457 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:21.082586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71da1a-217e-4c63-9c82-cdf26442c457 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:21.082858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71da1a-217e-4c63-9c82-cdf26442c457 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:21.092250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71da1a-217e-4c63-9c82-cdf26442c457 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:21.093822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb71da1a-217e-4c63-9c82-cdf26442c457 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:21.103687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 646/1293] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:23.170773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045d9e5-3c99-4fda-aaa8-3bd50ef99edb None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.171342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045d9e5-3c99-4fda-aaa8-3bd50ef99edb None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.171342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4045d9e5-3c99-4fda-aaa8-3bd50ef99edb None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.173076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 648/1294] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:23.178901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0a6ad-b686-49cb-8495-0a89f070a8aa None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.179293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0a6ad-b686-49cb-8495-0a89f070a8aa None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.179530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af0a6ad-b686-49cb-8495-0a89f070a8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.197147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-6af0a6ad-b686-49cb-8495-0a89f070a8aa None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:23.198340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-6af0a6ad-b686-49cb-8495-0a89f070a8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:23.206074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 647/1295] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:23.263747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173caf4-2456-4f45-a766-b1591efe498c None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.264026 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173caf4-2456-4f45-a766-b1591efe498c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.264298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173caf4-2456-4f45-a766-b1591efe498c None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.266207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 649/1296] 10.222.0.32 () {54 vars in 962 bytes} [Wed Oct 27 01:12:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:23.271755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8477af-ecaa-4420-8ccd-9ed0df70fc4f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.272034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8477af-ecaa-4420-8ccd-9ed0df70fc4f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.272302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8477af-ecaa-4420-8ccd-9ed0df70fc4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.318503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-cb8477af-ecaa-4420-8ccd-9ed0df70fc4f None None] MFA Rules not processed for user `9f402e17093e4e99afda5ea019f335eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:23.319673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-cb8477af-ecaa-4420-8ccd-9ed0df70fc4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:23.381612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 648/1297] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Oct 27 01:12:23 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:23.390446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173caf4-2456-4f45-a766-b1591efe498c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:23.401753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173caf4-2456-4f45-a766-b1591efe498c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:23.405357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f80dad-1aac-422a-8357-3b3cbf7b9f6d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f402e17093e4e99afda5ea019f335eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:23.406016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80dad-1aac-422a-8357-3b3cbf7b9f6d service glance] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.406322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80dad-1aac-422a-8357-3b3cbf7b9f6d service glance] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.406590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f80dad-1aac-422a-8357-3b3cbf7b9f6d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.416518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80dad-1aac-422a-8357-3b3cbf7b9f6d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:23.417951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f80dad-1aac-422a-8357-3b3cbf7b9f6d service glance] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:23.428275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 650/1298] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:12:23.551784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2489233-8d4c-4c28-a45d-475568b26179 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.552074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2489233-8d4c-4c28-a45d-475568b26179 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.552349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2489233-8d4c-4c28-a45d-475568b26179 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.554158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 649/1299] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:23 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:23.560788 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc14d-95e0-454b-8530-f6b86e35c3f9 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.561074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc14d-95e0-454b-8530-f6b86e35c3f9 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.561350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bc14d-95e0-454b-8530-f6b86e35c3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.579291 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-fd6bc14d-95e0-454b-8530-f6b86e35c3f9 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:23.580474 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-fd6bc14d-95e0-454b-8530-f6b86e35c3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:23.588328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 651/1300] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:12:23.635497 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2489233-8d4c-4c28-a45d-475568b26179 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:23.649776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2489233-8d4c-4c28-a45d-475568b26179 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:23.655330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11136058-552e-434d-b59f-20a1fda5a728 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:23.655954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11136058-552e-434d-b59f-20a1fda5a728 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:23.656229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11136058-552e-434d-b59f-20a1fda5a728 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:23.656497 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11136058-552e-434d-b59f-20a1fda5a728 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:23.664758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11136058-552e-434d-b59f-20a1fda5a728 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:23.666372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11136058-552e-434d-b59f-20a1fda5a728 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:23.675945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 650/1301] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:23 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:24.065465 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a81b0-8627-4733-b62b-8c546e3c67c2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:24.065844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a81b0-8627-4733-b62b-8c546e3c67c2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:24.066229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a81b0-8627-4733-b62b-8c546e3c67c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:24.119136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c66a81b0-8627-4733-b62b-8c546e3c67c2 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:24.120341 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c66a81b0-8627-4733-b62b-8c546e3c67c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:24.185009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 652/1302] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:12:24 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:24.230518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776854-5b2d-4ded-a68c-ff4a8eff6ad0 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:24.230985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776854-5b2d-4ded-a68c-ff4a8eff6ad0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:24.231264 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2776854-5b2d-4ded-a68c-ff4a8eff6ad0 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:24.233238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 651/1303] 10.222.0.32 () {54 vars in 942 bytes} [Wed Oct 27 01:12:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:24.240093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bfd9d-b088-46bc-8b31-48a36cbe4834 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:24.240382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bfd9d-b088-46bc-8b31-48a36cbe4834 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:24.240682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12bfd9d-b088-46bc-8b31-48a36cbe4834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:24.289713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e12bfd9d-b088-46bc-8b31-48a36cbe4834 None None] MFA Rules not processed for user `3856a21179234c9ebcbd4a9bd7ee3945`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:24.290944 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e12bfd9d-b088-46bc-8b31-48a36cbe4834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:24.361864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 653/1304] 10.222.0.32 () {58 vars in 1039 bytes} [Wed Oct 27 01:12:24 2021] POST /identity/v3/auth/tokens => generated 3447 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:24.372250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776854-5b2d-4ded-a68c-ff4a8eff6ad0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:24.386744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2776854-5b2d-4ded-a68c-ff4a8eff6ad0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:24.391577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477745f-2127-4fb4-bf1d-9fcfc1564cb3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:24.392205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477745f-2127-4fb4-bf1d-9fcfc1564cb3 service swift] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:24.392487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477745f-2127-4fb4-bf1d-9fcfc1564cb3 service swift] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:24.392763 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477745f-2127-4fb4-bf1d-9fcfc1564cb3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:24.401006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477745f-2127-4fb4-bf1d-9fcfc1564cb3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:24.402636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1477745f-2127-4fb4-bf1d-9fcfc1564cb3 service swift] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:24.410432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 652/1305] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:12:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:12:26.172288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd118-5d7f-4c38-853f-404bcf20c8d3 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:26.173172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd118-5d7f-4c38-853f-404bcf20c8d3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:26.173616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163cd118-5d7f-4c38-853f-404bcf20c8d3 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:26.175433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 654/1306] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:26 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:26.181340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a4e52-7682-4aaa-a440-9ae6cf040115 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:26.182167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a4e52-7682-4aaa-a440-9ae6cf040115 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:26.182668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a4e52-7682-4aaa-a440-9ae6cf040115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:26.206113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b36a4e52-7682-4aaa-a440-9ae6cf040115 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:26.207335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b36a4e52-7682-4aaa-a440-9ae6cf040115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:26.225539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 653/1307] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:26.274398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cd118-5d7f-4c38-853f-404bcf20c8d3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:26.289459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163cd118-5d7f-4c38-853f-404bcf20c8d3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:26.295115 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83b03f-6bd8-487b-9686-fd46c8cffa29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:26.295780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83b03f-6bd8-487b-9686-fd46c8cffa29 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:26.296052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83b03f-6bd8-487b-9686-fd46c8cffa29 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:26.296322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83b03f-6bd8-487b-9686-fd46c8cffa29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:26.304700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83b03f-6bd8-487b-9686-fd46c8cffa29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:26.306675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83b03f-6bd8-487b-9686-fd46c8cffa29 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:26.318415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 655/1308] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:28.815719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fcd47-2fe7-48d5-9b8c-c3e678b7737f None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:28.816255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fcd47-2fe7-48d5-9b8c-c3e678b7737f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:28.816367 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516fcd47-2fe7-48d5-9b8c-c3e678b7737f None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:28.818249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 654/1309] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:28 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:28.824598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786749-f0b6-487c-ae4d-ebcb042a33d2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:28.825072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786749-f0b6-487c-ae4d-ebcb042a33d2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:28.825163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1786749-f0b6-487c-ae4d-ebcb042a33d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:28.844230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d1786749-f0b6-487c-ae4d-ebcb042a33d2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:28.845459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d1786749-f0b6-487c-ae4d-ebcb042a33d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:28.856267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 656/1310] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:28.903829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fcd47-2fe7-48d5-9b8c-c3e678b7737f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:28.920106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516fcd47-2fe7-48d5-9b8c-c3e678b7737f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:28.926528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89984049-0f92-4693-b148-4047c33f0fd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:28.927370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89984049-0f92-4693-b148-4047c33f0fd7 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:28.927727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89984049-0f92-4693-b148-4047c33f0fd7 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:28.928008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89984049-0f92-4693-b148-4047c33f0fd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:28.937968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89984049-0f92-4693-b148-4047c33f0fd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:28.938892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89984049-0f92-4693-b148-4047c33f0fd7 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:28.949016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 655/1311] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:12:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:12:43.041154 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f86b23-a89f-4d84-a5cd-f424266d6651 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:43.041682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f86b23-a89f-4d84-a5cd-f424266d6651 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:43.041682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f86b23-a89f-4d84-a5cd-f424266d6651 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:43.043559 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 657/1312] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:43 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:43.049369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997b836-9963-4345-acc3-bed4bfc23779 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:43.049807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997b836-9963-4345-acc3-bed4bfc23779 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:43.049915 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e997b836-9963-4345-acc3-bed4bfc23779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:43.069607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e997b836-9963-4345-acc3-bed4bfc23779 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:43.070894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e997b836-9963-4345-acc3-bed4bfc23779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:43.078440 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 656/1313] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:43.108052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f86b23-a89f-4d84-a5cd-f424266d6651 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:43.120135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f86b23-a89f-4d84-a5cd-f424266d6651 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:43.124524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4874a5-10f0-49bf-995f-f2f8a0fbe474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:43.125153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4874a5-10f0-49bf-995f-f2f8a0fbe474 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:43.125425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4874a5-10f0-49bf-995f-f2f8a0fbe474 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:43.125690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4874a5-10f0-49bf-995f-f2f8a0fbe474 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:43.126703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4874a5-10f0-49bf-995f-f2f8a0fbe474 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:43.128506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4874a5-10f0-49bf-995f-f2f8a0fbe474 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:43.146586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 658/1314] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:12:43 2021] GET /identity/v3/projects => generated 2553 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:12:45.349879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3d79-9fc9-4d37-9972-8d06bdf7e385 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:45.350462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3d79-9fc9-4d37-9972-8d06bdf7e385 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:45.350462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6d3d79-9fc9-4d37-9972-8d06bdf7e385 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:45.352803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 657/1315] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:45 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:45.358784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27ed9-e891-4f3c-9e46-c4aca9cc0de0 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:45.359262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27ed9-e891-4f3c-9e46-c4aca9cc0de0 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:45.359368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27ed9-e891-4f3c-9e46-c4aca9cc0de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:45.377172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d4f27ed9-e891-4f3c-9e46-c4aca9cc0de0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:45.378394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d4f27ed9-e891-4f3c-9e46-c4aca9cc0de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:45.386268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 659/1316] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:12:45.410125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3d79-9fc9-4d37-9972-8d06bdf7e385 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:45.423339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6d3d79-9fc9-4d37-9972-8d06bdf7e385 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:45.427914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898985-f6bd-47cd-8af0-8dadeb5893dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:45.428744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898985-f6bd-47cd-8af0-8dadeb5893dc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:45.429249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898985-f6bd-47cd-8af0-8dadeb5893dc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:45.429726 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d898985-f6bd-47cd-8af0-8dadeb5893dc admin admin] PATH_INFO: `/v3/projects/3355962a746e4ae38c08a8001aa0f51d` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:45.430948 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898985-f6bd-47cd-8af0-8dadeb5893dc admin admin] RBAC: Authorizing `identity:get_project(project_id=3355962a746e4ae38c08a8001aa0f51d)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:45.432825 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d898985-f6bd-47cd-8af0-8dadeb5893dc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:45.434532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 658/1317] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:12:45 2021] GET /identity/v3/projects/3355962a746e4ae38c08a8001aa0f51d => generated 344 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:45.440899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27ed9-e891-4f3c-9e46-c4aca9cc0de0 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:45.449676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27ed9-e891-4f3c-9e46-c4aca9cc0de0 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:45.454140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d757ffe1-a89e-49da-abfc-fa732543ea65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:45.454764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757ffe1-a89e-49da-abfc-fa732543ea65 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:45.455035 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757ffe1-a89e-49da-abfc-fa732543ea65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:45.455302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d757ffe1-a89e-49da-abfc-fa732543ea65 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:45.456063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757ffe1-a89e-49da-abfc-fa732543ea65 admin admin] RBAC: Adding query filter params (scope.project.id=3355962a746e4ae38c08a8001aa0f51d) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:45.456359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757ffe1-a89e-49da-abfc-fa732543ea65 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:45.458181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d757ffe1-a89e-49da-abfc-fa732543ea65 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:45.465362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 660/1318] 10.222.0.32 () {56 vars in 1231 bytes} [Wed Oct 27 01:12:45 2021] GET /identity/v3/role_assignments?scope.project.id=3355962a746e4ae38c08a8001aa0f51d => generated 879 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:45.471521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898985-f6bd-47cd-8af0-8dadeb5893dc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:45.481463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d898985-f6bd-47cd-8af0-8dadeb5893dc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:45.485849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f0621-b3fb-49a8-a06a-a3086d63c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:45.486715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f0621-b3fb-49a8-a06a-a3086d63c9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:45.486992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f0621-b3fb-49a8-a06a-a3086d63c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:45.487261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f0621-b3fb-49a8-a06a-a3086d63c9d4 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:45.488424 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f0621-b3fb-49a8-a06a-a3086d63c9d4 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:45.490210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f0621-b3fb-49a8-a06a-a3086d63c9d4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:45.491750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 659/1319] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:12:45 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:47.809130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e04f3-ba84-4a21-aa23-d7aa4755bed8 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:47.809696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e04f3-ba84-4a21-aa23-d7aa4755bed8 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:47.809696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e04f3-ba84-4a21-aa23-d7aa4755bed8 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:47.811534 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 661/1320] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:47 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:47.817533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf49ef3-4a12-4be4-af7f-054a288fde6f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:47.817939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf49ef3-4a12-4be4-af7f-054a288fde6f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:47.818109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf49ef3-4a12-4be4-af7f-054a288fde6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:47.835489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-2bf49ef3-4a12-4be4-af7f-054a288fde6f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:47.836675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2bf49ef3-4a12-4be4-af7f-054a288fde6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:47.844307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 660/1321] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:12:47.868825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e04f3-ba84-4a21-aa23-d7aa4755bed8 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:47.881045 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e04f3-ba84-4a21-aa23-d7aa4755bed8 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:47.885546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86ee93-1b5c-4a69-9902-1c8ef523d3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:47.886411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86ee93-1b5c-4a69-9902-1c8ef523d3db admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:47.886690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86ee93-1b5c-4a69-9902-1c8ef523d3db admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:47.886958 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c86ee93-1b5c-4a69-9902-1c8ef523d3db admin admin] PATH_INFO: `/v3/projects/48e043513d104d7bae45a9a675c73782` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:47.897529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86ee93-1b5c-4a69-9902-1c8ef523d3db admin admin] RBAC: Authorizing `identity:get_project(project_id=48e043513d104d7bae45a9a675c73782)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:47.899825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c86ee93-1b5c-4a69-9902-1c8ef523d3db admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:47.901507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 662/1322] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:12:47 2021] GET /identity/v3/projects/48e043513d104d7bae45a9a675c73782 => generated 361 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:47.908098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf49ef3-4a12-4be4-af7f-054a288fde6f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:47.917665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf49ef3-4a12-4be4-af7f-054a288fde6f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:47.922127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d533d818-86b6-4f8c-8be6-cace8a380d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:47.922763 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533d818-86b6-4f8c-8be6-cace8a380d41 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:47.923040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533d818-86b6-4f8c-8be6-cace8a380d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:47.923312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d533d818-86b6-4f8c-8be6-cace8a380d41 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:47.924076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533d818-86b6-4f8c-8be6-cace8a380d41 admin admin] RBAC: Adding query filter params (scope.project.id=48e043513d104d7bae45a9a675c73782) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:47.924377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533d818-86b6-4f8c-8be6-cace8a380d41 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:47.926200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d533d818-86b6-4f8c-8be6-cace8a380d41 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:47.933006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 661/1323] 10.222.0.32 () {56 vars in 1231 bytes} [Wed Oct 27 01:12:47 2021] GET /identity/v3/role_assignments?scope.project.id=48e043513d104d7bae45a9a675c73782 => generated 526 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:47.939053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86ee93-1b5c-4a69-9902-1c8ef523d3db admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:47.948499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c86ee93-1b5c-4a69-9902-1c8ef523d3db admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:47.953020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9d6abd-50a4-48a4-a115-88c4bd9d5662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:47.953855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6abd-50a4-48a4-a115-88c4bd9d5662 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:47.954170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6abd-50a4-48a4-a115-88c4bd9d5662 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:47.954446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9d6abd-50a4-48a4-a115-88c4bd9d5662 admin admin] PATH_INFO: `/v3/users/85cd8e94d936426c9514367bad28c715` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:47.967526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d6abd-50a4-48a4-a115-88c4bd9d5662 admin admin] RBAC: Authorizing `identity:get_user(user_id=85cd8e94d936426c9514367bad28c715)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:47.969612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9d6abd-50a4-48a4-a115-88c4bd9d5662 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:47.971240 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 663/1324] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:12:47 2021] GET /identity/v3/users/85cd8e94d936426c9514367bad28c715 => generated 311 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:50.211983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a84bb-4988-4c04-b4a8-47854eb79b91 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.212538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a84bb-4988-4c04-b4a8-47854eb79b91 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.212538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a84bb-4988-4c04-b4a8-47854eb79b91 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.214311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 662/1325] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:50 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:12:50.220277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9d46e-3240-428c-ad4a-7463d06dc363 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.220710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9d46e-3240-428c-ad4a-7463d06dc363 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.227711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c9d46e-3240-428c-ad4a-7463d06dc363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.238344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-b6c9d46e-3240-428c-ad4a-7463d06dc363 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:50.239655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b6c9d46e-3240-428c-ad4a-7463d06dc363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:50.248343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 664/1326] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:12:50.273203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a84bb-4988-4c04-b4a8-47854eb79b91 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:50.285223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a84bb-4988-4c04-b4a8-47854eb79b91 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.290214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1738ef2-f2ae-4d65-8f8d-65386a4e5f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:50.291148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1738ef2-f2ae-4d65-8f8d-65386a4e5f2a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.291419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1738ef2-f2ae-4d65-8f8d-65386a4e5f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.291683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1738ef2-f2ae-4d65-8f8d-65386a4e5f2a admin admin] PATH_INFO: `/v3/projects/4d4f8cf5773f4074b83a335c1b11f025` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.302255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1738ef2-f2ae-4d65-8f8d-65386a4e5f2a admin admin] RBAC: Authorizing `identity:get_project(project_id=4d4f8cf5773f4074b83a335c1b11f025)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:50.305041 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1738ef2-f2ae-4d65-8f8d-65386a4e5f2a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:50.306744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 663/1327] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:12:50 2021] GET /identity/v3/projects/4d4f8cf5773f4074b83a335c1b11f025 => generated 298 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:50.313416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9d46e-3240-428c-ad4a-7463d06dc363 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:50.323405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c9d46e-3240-428c-ad4a-7463d06dc363 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.327931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed9659-bf45-47d0-a2f0-d750acc3b0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:50.328566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9659-bf45-47d0-a2f0-d750acc3b0ba admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.328845 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9659-bf45-47d0-a2f0-d750acc3b0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.329118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ed9659-bf45-47d0-a2f0-d750acc3b0ba admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.329889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed9659-bf45-47d0-a2f0-d750acc3b0ba admin admin] RBAC: Adding query filter params (scope.project.id=4d4f8cf5773f4074b83a335c1b11f025) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:50.330220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed9659-bf45-47d0-a2f0-d750acc3b0ba admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:50.332040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ed9659-bf45-47d0-a2f0-d750acc3b0ba admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:50.339710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 665/1328] 10.222.0.32 () {56 vars in 1231 bytes} [Wed Oct 27 01:12:50 2021] GET /identity/v3/role_assignments?scope.project.id=4d4f8cf5773f4074b83a335c1b11f025 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:12:50.345881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1738ef2-f2ae-4d65-8f8d-65386a4e5f2a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:50.355517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1738ef2-f2ae-4d65-8f8d-65386a4e5f2a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.359920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f8c501-04ac-4ecd-bce0-72eac4229835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:50.360767 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8c501-04ac-4ecd-bce0-72eac4229835 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.361043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8c501-04ac-4ecd-bce0-72eac4229835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.361310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f8c501-04ac-4ecd-bce0-72eac4229835 admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.375161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8c501-04ac-4ecd-bce0-72eac4229835 admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:50.377519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f8c501-04ac-4ecd-bce0-72eac4229835 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:50.379153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 664/1329] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:12:50 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:50.386075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed9659-bf45-47d0-a2f0-d750acc3b0ba admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:50.395575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ed9659-bf45-47d0-a2f0-d750acc3b0ba admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:50.401036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c6287-2d93-402a-bd37-663ae42f0e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:50.401896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c6287-2d93-402a-bd37-663ae42f0e86 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:50.402204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c6287-2d93-402a-bd37-663ae42f0e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:50.402478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c6287-2d93-402a-bd37-663ae42f0e86 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:50.403665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c6287-2d93-402a-bd37-663ae42f0e86 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:50.405425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c6287-2d93-402a-bd37-663ae42f0e86 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:50.407052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 666/1330] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:12:50 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:52.705442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ff46-f83e-4e3d-b36c-7e4375d897b5 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:52.706006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ff46-f83e-4e3d-b36c-7e4375d897b5 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:52.706006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714ff46-f83e-4e3d-b36c-7e4375d897b5 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:52.707757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 665/1331] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:52 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:52.714308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d7a0a-9328-47c0-a1c2-023706ab7f13 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:52.714762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d7a0a-9328-47c0-a1c2-023706ab7f13 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:52.714863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d7a0a-9328-47c0-a1c2-023706ab7f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:52.732598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-015d7a0a-9328-47c0-a1c2-023706ab7f13 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:52.733753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-015d7a0a-9328-47c0-a1c2-023706ab7f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:52.741395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 667/1332] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:12:52.765486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714ff46-f83e-4e3d-b36c-7e4375d897b5 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:52.778393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714ff46-f83e-4e3d-b36c-7e4375d897b5 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:52.782745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eba9a-dac4-4063-9793-31fde0e77a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:52.783611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eba9a-dac4-4063-9793-31fde0e77a1c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:52.783889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eba9a-dac4-4063-9793-31fde0e77a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:52.784156 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1eba9a-dac4-4063-9793-31fde0e77a1c admin admin] PATH_INFO: `/v3/projects/4f57dca270564e15b40b0a58b6284c77` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:52.795329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1eba9a-dac4-4063-9793-31fde0e77a1c admin admin] RBAC: Authorizing `identity:get_project(project_id=4f57dca270564e15b40b0a58b6284c77)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:52.797353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1eba9a-dac4-4063-9793-31fde0e77a1c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:52.799054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 666/1333] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:12:52 2021] GET /identity/v3/projects/4f57dca270564e15b40b0a58b6284c77 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:52.805658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d7a0a-9328-47c0-a1c2-023706ab7f13 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:52.814400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d7a0a-9328-47c0-a1c2-023706ab7f13 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:52.818818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05bf55a-6c33-4f4c-8d05-37c33ed63d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:52.819446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf55a-6c33-4f4c-8d05-37c33ed63d6b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:52.819715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf55a-6c33-4f4c-8d05-37c33ed63d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:52.819981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05bf55a-6c33-4f4c-8d05-37c33ed63d6b admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:52.820740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bf55a-6c33-4f4c-8d05-37c33ed63d6b admin admin] RBAC: Adding query filter params (scope.project.id=4f57dca270564e15b40b0a58b6284c77) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:52.821042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bf55a-6c33-4f4c-8d05-37c33ed63d6b admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:52.822887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05bf55a-6c33-4f4c-8d05-37c33ed63d6b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:52.828061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 668/1334] 10.222.0.32 () {56 vars in 1231 bytes} [Wed Oct 27 01:12:52 2021] GET /identity/v3/role_assignments?scope.project.id=4f57dca270564e15b40b0a58b6284c77 => generated 526 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:52.834162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eba9a-dac4-4063-9793-31fde0e77a1c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:52.844029 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1eba9a-dac4-4063-9793-31fde0e77a1c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:52.848739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe4ebad-061b-4f2b-b439-de8b974f22d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:52.849659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ebad-061b-4f2b-b439-de8b974f22d6 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:52.849939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ebad-061b-4f2b-b439-de8b974f22d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:52.850239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe4ebad-061b-4f2b-b439-de8b974f22d6 admin admin] PATH_INFO: `/v3/users/57039dc4b1ff4cc3b9e5655fa295a287` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:52.864147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4ebad-061b-4f2b-b439-de8b974f22d6 admin admin] RBAC: Authorizing `identity:get_user(user_id=57039dc4b1ff4cc3b9e5655fa295a287)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:52.866686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe4ebad-061b-4f2b-b439-de8b974f22d6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:52.868375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 667/1335] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:12:52 2021] GET /identity/v3/users/57039dc4b1ff4cc3b9e5655fa295a287 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:55.209360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904fdb1-e31c-4d40-bf60-6913d7f656ad None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:55.210349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904fdb1-e31c-4d40-bf60-6913d7f656ad None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:55.210456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904fdb1-e31c-4d40-bf60-6913d7f656ad None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:55.212176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 669/1336] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:55 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:55.218083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f40d-86b8-48e7-9f6c-703b51c50ea1 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:55.218518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f40d-86b8-48e7-9f6c-703b51c50ea1 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:55.218625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999f40d-86b8-48e7-9f6c-703b51c50ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:55.236145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b999f40d-86b8-48e7-9f6c-703b51c50ea1 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:55.237320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b999f40d-86b8-48e7-9f6c-703b51c50ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:55.245061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 668/1337] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:12:55.269648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904fdb1-e31c-4d40-bf60-6913d7f656ad None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:55.282285 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904fdb1-e31c-4d40-bf60-6913d7f656ad None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:55.286818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b2cfa-662c-47d1-8a8f-4f21120f51d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:55.287673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b2cfa-662c-47d1-8a8f-4f21120f51d5 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:55.288061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b2cfa-662c-47d1-8a8f-4f21120f51d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:55.288337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b2cfa-662c-47d1-8a8f-4f21120f51d5 admin admin] PATH_INFO: `/v3/projects/a767e19648dd4ee78d2439f37a731774` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:55.298879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b2cfa-662c-47d1-8a8f-4f21120f51d5 admin admin] RBAC: Authorizing `identity:get_project(project_id=a767e19648dd4ee78d2439f37a731774)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:55.300897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b2cfa-662c-47d1-8a8f-4f21120f51d5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:55.302598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 670/1338] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:12:55 2021] GET /identity/v3/projects/a767e19648dd4ee78d2439f37a731774 => generated 302 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:55.309659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f40d-86b8-48e7-9f6c-703b51c50ea1 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:55.318749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999f40d-86b8-48e7-9f6c-703b51c50ea1 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:55.324251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4acdf4-6ffd-457d-891c-6ed0bda2e28e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:55.329370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4acdf4-6ffd-457d-891c-6ed0bda2e28e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:55.329370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4acdf4-6ffd-457d-891c-6ed0bda2e28e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:55.329370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4acdf4-6ffd-457d-891c-6ed0bda2e28e admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:55.329370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4acdf4-6ffd-457d-891c-6ed0bda2e28e admin admin] RBAC: Adding query filter params (scope.project.id=a767e19648dd4ee78d2439f37a731774) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:55.329370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4acdf4-6ffd-457d-891c-6ed0bda2e28e admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:55.329370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4acdf4-6ffd-457d-891c-6ed0bda2e28e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:55.336204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 669/1339] 10.222.0.32 () {56 vars in 1231 bytes} [Wed Oct 27 01:12:55 2021] GET /identity/v3/role_assignments?scope.project.id=a767e19648dd4ee78d2439f37a731774 => generated 1934 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:12:55.342460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b2cfa-662c-47d1-8a8f-4f21120f51d5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:55.351961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b2cfa-662c-47d1-8a8f-4f21120f51d5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:55.358120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb7af3-3a82-46ff-bc5e-b41cbdaf03d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:55.358120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb7af3-3a82-46ff-bc5e-b41cbdaf03d7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:55.358120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb7af3-3a82-46ff-bc5e-b41cbdaf03d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:55.358120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb7af3-3a82-46ff-bc5e-b41cbdaf03d7 admin admin] PATH_INFO: `/v3/users/5c3a6c2e10d54dfc8b895992ac771847` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:55.359284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb7af3-3a82-46ff-bc5e-b41cbdaf03d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=5c3a6c2e10d54dfc8b895992ac771847)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:55.361051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb7af3-3a82-46ff-bc5e-b41cbdaf03d7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:55.362789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 671/1340] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:12:55 2021] GET /identity/v3/users/5c3a6c2e10d54dfc8b895992ac771847 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:12:55.368931 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4acdf4-6ffd-457d-891c-6ed0bda2e28e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:55.378726 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4acdf4-6ffd-457d-891c-6ed0bda2e28e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:55.384082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ae437-4cc7-455a-8b85-0c02df04ee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:55.384923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ae437-4cc7-455a-8b85-0c02df04ee28 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:55.385203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ae437-4cc7-455a-8b85-0c02df04ee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:55.385475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ae437-4cc7-455a-8b85-0c02df04ee28 admin admin] PATH_INFO: `/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:55.399236 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ae437-4cc7-455a-8b85-0c02df04ee28 admin admin] RBAC: Authorizing `identity:get_user(user_id=46a6e8f6c3d74cc788462f162cd3e2ce)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:55.401422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ae437-4cc7-455a-8b85-0c02df04ee28 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:55.403152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 670/1341] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:12:55 2021] GET /identity/v3/users/46a6e8f6c3d74cc788462f162cd3e2ce => generated 283 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:57.728389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e9947-183d-4a8c-a416-07bd6aa089e6 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:57.728947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e9947-183d-4a8c-a416-07bd6aa089e6 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:57.728947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595e9947-183d-4a8c-a416-07bd6aa089e6 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:57.730733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 672/1342] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:12:57 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:12:57.736680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa489a-0419-4aed-ae97-066169db3ddd None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:57.737061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa489a-0419-4aed-ae97-066169db3ddd None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:57.737216 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faa489a-0419-4aed-ae97-066169db3ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:57.754858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-0faa489a-0419-4aed-ae97-066169db3ddd None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:12:57.756016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0faa489a-0419-4aed-ae97-066169db3ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:12:57.763692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 671/1343] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:12:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:12:57.787277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e9947-183d-4a8c-a416-07bd6aa089e6 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:57.799877 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595e9947-183d-4a8c-a416-07bd6aa089e6 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:57.804460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6c218-8a47-47ba-b4eb-c8949f1bf292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:57.805275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6c218-8a47-47ba-b4eb-c8949f1bf292 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:57.805551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6c218-8a47-47ba-b4eb-c8949f1bf292 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:57.806238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6c218-8a47-47ba-b4eb-c8949f1bf292 admin admin] PATH_INFO: `/v3/projects/b991dc97602e4f83a48dfb61d3218477` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:57.816390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6c218-8a47-47ba-b4eb-c8949f1bf292 admin admin] RBAC: Authorizing `identity:get_project(project_id=b991dc97602e4f83a48dfb61d3218477)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:57.818441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6c218-8a47-47ba-b4eb-c8949f1bf292 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:57.820689 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 673/1344] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:12:57 2021] GET /identity/v3/projects/b991dc97602e4f83a48dfb61d3218477 => generated 312 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:57.827229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa489a-0419-4aed-ae97-066169db3ddd None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:57.836678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faa489a-0419-4aed-ae97-066169db3ddd None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:57.841128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f407a6-b72e-49e0-888f-365b62ecc6bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:57.841776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f407a6-b72e-49e0-888f-365b62ecc6bc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:57.842045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f407a6-b72e-49e0-888f-365b62ecc6bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:57.842327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f407a6-b72e-49e0-888f-365b62ecc6bc admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:57.843088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f407a6-b72e-49e0-888f-365b62ecc6bc admin admin] RBAC: Adding query filter params (scope.project.id=b991dc97602e4f83a48dfb61d3218477) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:12:57.843384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f407a6-b72e-49e0-888f-365b62ecc6bc admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:57.845181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f407a6-b72e-49e0-888f-365b62ecc6bc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:57.850659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 672/1345] 10.222.0.32 () {56 vars in 1231 bytes} [Wed Oct 27 01:12:57 2021] GET /identity/v3/role_assignments?scope.project.id=b991dc97602e4f83a48dfb61d3218477 => generated 526 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:12:57.856713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6c218-8a47-47ba-b4eb-c8949f1bf292 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:12:57.866297 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6c218-8a47-47ba-b4eb-c8949f1bf292 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:12:57.870809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9751fe28-cdcb-4d2b-9a9f-02ae470063d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:12:57.871649 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751fe28-cdcb-4d2b-9a9f-02ae470063d2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:12:57.871929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751fe28-cdcb-4d2b-9a9f-02ae470063d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:12:57.872265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9751fe28-cdcb-4d2b-9a9f-02ae470063d2 admin admin] PATH_INFO: `/v3/users/73d3f947148f405db4b58b5f3f2f3c73` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:12:57.873451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751fe28-cdcb-4d2b-9a9f-02ae470063d2 admin admin] RBAC: Authorizing `identity:get_user(user_id=73d3f947148f405db4b58b5f3f2f3c73)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:12:57.875817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9751fe28-cdcb-4d2b-9a9f-02ae470063d2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:12:57.877386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 674/1346] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:12:57 2021] GET /identity/v3/users/73d3f947148f405db4b58b5f3f2f3c73 => generated 275 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:00.147435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c58a-3c5c-4cd3-8c9e-520a11d53f3f None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:00.148039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c58a-3c5c-4cd3-8c9e-520a11d53f3f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:00.148039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d06c58a-3c5c-4cd3-8c9e-520a11d53f3f None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:00.149746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 673/1347] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:00 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:00.155517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89254ab-77bd-45e3-a984-02e04b6d2be2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:00.155904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89254ab-77bd-45e3-a984-02e04b6d2be2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:00.156059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89254ab-77bd-45e3-a984-02e04b6d2be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:00.173834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f89254ab-77bd-45e3-a984-02e04b6d2be2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:00.175036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f89254ab-77bd-45e3-a984-02e04b6d2be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:00.183437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 675/1348] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:13:00.206356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06c58a-3c5c-4cd3-8c9e-520a11d53f3f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:00.218930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d06c58a-3c5c-4cd3-8c9e-520a11d53f3f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:00.223295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70f80-fb89-4926-98f4-2e23e73face8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:00.224121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70f80-fb89-4926-98f4-2e23e73face8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:00.224393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70f80-fb89-4926-98f4-2e23e73face8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:00.224660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c70f80-fb89-4926-98f4-2e23e73face8 admin admin] PATH_INFO: `/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:00.236186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c70f80-fb89-4926-98f4-2e23e73face8 admin admin] RBAC: Authorizing `identity:get_project(project_id=f23eaa5ee4644267a1ca4bdd702bf2e1)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:00.238337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c70f80-fb89-4926-98f4-2e23e73face8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:00.240002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 674/1349] 10.222.0.32 () {56 vars in 1207 bytes} [Wed Oct 27 01:13:00 2021] GET /identity/v3/projects/f23eaa5ee4644267a1ca4bdd702bf2e1 => generated 311 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:00.246800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89254ab-77bd-45e3-a984-02e04b6d2be2 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:00.255919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89254ab-77bd-45e3-a984-02e04b6d2be2 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:00.260553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a2ab4-44f9-43ca-bd16-c6362c38f1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:00.261220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a2ab4-44f9-43ca-bd16-c6362c38f1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:00.261493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a2ab4-44f9-43ca-bd16-c6362c38f1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:00.261758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a2ab4-44f9-43ca-bd16-c6362c38f1d0 admin admin] PATH_INFO: `/v3/role_assignments` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:00.262561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a2ab4-44f9-43ca-bd16-c6362c38f1d0 admin admin] RBAC: Adding query filter params (scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:13:00.262854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a2ab4-44f9-43ca-bd16-c6362c38f1d0 admin admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:00.264674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6a2ab4-44f9-43ca-bd16-c6362c38f1d0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:00.270434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 676/1350] 10.222.0.32 () {56 vars in 1231 bytes} [Wed Oct 27 01:13:00 2021] GET /identity/v3/role_assignments?scope.project.id=f23eaa5ee4644267a1ca4bdd702bf2e1 => generated 877 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:00.277270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70f80-fb89-4926-98f4-2e23e73face8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:00.286775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c70f80-fb89-4926-98f4-2e23e73face8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:00.291956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b41cb5c-6542-41d6-bbcc-831c53190e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:00.292798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41cb5c-6542-41d6-bbcc-831c53190e1a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:00.293075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41cb5c-6542-41d6-bbcc-831c53190e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:00.293343 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b41cb5c-6542-41d6-bbcc-831c53190e1a admin admin] PATH_INFO: `/v3/users/1254388a078440299873aca35bcc973c` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:00.306325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41cb5c-6542-41d6-bbcc-831c53190e1a admin admin] RBAC: Authorizing `identity:get_user(user_id=1254388a078440299873aca35bcc973c)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:00.308428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b41cb5c-6542-41d6-bbcc-831c53190e1a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:00.310044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 675/1351] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:13:00 2021] GET /identity/v3/users/1254388a078440299873aca35bcc973c => generated 285 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:00.316241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a2ab4-44f9-43ca-bd16-c6362c38f1d0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:00.325846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a2ab4-44f9-43ca-bd16-c6362c38f1d0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:00.330431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ce6fe5-9e40-44e4-b1b5-575f82e81781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:00.331264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce6fe5-9e40-44e4-b1b5-575f82e81781 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:00.331563 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce6fe5-9e40-44e4-b1b5-575f82e81781 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:00.331828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ce6fe5-9e40-44e4-b1b5-575f82e81781 admin admin] PATH_INFO: `/v3/users/6f3f5644aa15436691683ff0b14a5b06` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:00.345418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce6fe5-9e40-44e4-b1b5-575f82e81781 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f3f5644aa15436691683ff0b14a5b06)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:00.347526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ce6fe5-9e40-44e4-b1b5-575f82e81781 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:00.349122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 677/1352] 10.222.0.32 () {56 vars in 1198 bytes} [Wed Oct 27 01:13:00 2021] GET /identity/v3/users/6f3f5644aa15436691683ff0b14a5b06 => generated 286 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:13:05.724227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a21f8-24dc-4c0f-bd3a-6561867028b9 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:05.724934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a21f8-24dc-4c0f-bd3a-6561867028b9 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:05.724934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5a21f8-24dc-4c0f-bd3a-6561867028b9 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:05.726575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 676/1353] 10.222.0.32 () {54 vars in 918 bytes} [Wed Oct 27 01:13:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:05.733278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdbb3a-427e-4d01-b77b-a491fe1a2095 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:05.733822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdbb3a-427e-4d01-b77b-a491fe1a2095 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:05.733822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afdbb3a-427e-4d01-b77b-a491fe1a2095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:05.751051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0afdbb3a-427e-4d01-b77b-a491fe1a2095 None None] MFA Rules not processed for user `8df6e02fde834883aef230f31d6ecd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:05.752206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0afdbb3a-427e-4d01-b77b-a491fe1a2095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:05.761256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 678/1354] 10.222.0.32 () {58 vars in 1015 bytes} [Wed Oct 27 01:13:05 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:05.776759 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dde466-88e6-4846-bf71-2c9e62fb0428 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:05.777042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dde466-88e6-4846-bf71-2c9e62fb0428 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:05.777363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dde466-88e6-4846-bf71-2c9e62fb0428 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:05.779144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 677/1355] 10.222.0.32 () {54 vars in 918 bytes} [Wed Oct 27 01:13:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:05.784177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd6b74-c879-48f5-a962-5a13bcdaf0a9 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:05.784458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd6b74-c879-48f5-a962-5a13bcdaf0a9 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:05.784731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd6b74-c879-48f5-a962-5a13bcdaf0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:05.802046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f0dd6b74-c879-48f5-a962-5a13bcdaf0a9 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:05.803639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f0dd6b74-c879-48f5-a962-5a13bcdaf0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:05.812341 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 679/1356] 10.222.0.32 () {58 vars in 1015 bytes} [Wed Oct 27 01:13:05 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:08.696222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0956fa-e638-45e8-bb2d-7270b640b606 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:08.696783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0956fa-e638-45e8-bb2d-7270b640b606 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:08.696783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0956fa-e638-45e8-bb2d-7270b640b606 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:08.698559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 678/1357] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:08 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:08.704397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b7fe9-f739-473a-9e99-6109ea694398 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:08.704810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b7fe9-f739-473a-9e99-6109ea694398 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:08.704967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43b7fe9-f739-473a-9e99-6109ea694398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:08.723451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-a43b7fe9-f739-473a-9e99-6109ea694398 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:08.724654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a43b7fe9-f739-473a-9e99-6109ea694398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:08.732383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 680/1358] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:08 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:13:08.776586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0956fa-e638-45e8-bb2d-7270b640b606 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:08.791000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0956fa-e638-45e8-bb2d-7270b640b606 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:08.796193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa9e48-5b44-4090-a7fd-0e0cb4182f55 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:08.796813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa9e48-5b44-4090-a7fd-0e0cb4182f55 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:08.797085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa9e48-5b44-4090-a7fd-0e0cb4182f55 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:08.797351 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa9e48-5b44-4090-a7fd-0e0cb4182f55 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:08.805721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa9e48-5b44-4090-a7fd-0e0cb4182f55 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:08.807301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa9e48-5b44-4090-a7fd-0e0cb4182f55 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:08.816186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 679/1359] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:08 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:10.446784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff380d6e-0fa2-4ac2-bb8b-17490770b47f None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:10.447343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff380d6e-0fa2-4ac2-bb8b-17490770b47f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:10.447343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff380d6e-0fa2-4ac2-bb8b-17490770b47f None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:10.449073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 681/1360] 10.222.0.32 () {54 vars in 911 bytes} [Wed Oct 27 01:13:10 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:10.454571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478f8f7-6b86-4477-8789-f8ca2c9f8e4f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:10.454977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478f8f7-6b86-4477-8789-f8ca2c9f8e4f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:10.455121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478f8f7-6b86-4477-8789-f8ca2c9f8e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:10.472511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-3478f8f7-6b86-4477-8789-f8ca2c9f8e4f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:10.473679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3478f8f7-6b86-4477-8789-f8ca2c9f8e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:10.481813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 680/1361] 10.222.0.32 () {58 vars in 1008 bytes} [Wed Oct 27 01:13:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:10.635083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff380d6e-0fa2-4ac2-bb8b-17490770b47f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:10.649489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff380d6e-0fa2-4ac2-bb8b-17490770b47f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:10.654892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f5c50-f113-4331-b53a-1ce920bb953e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:10.655524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5c50-f113-4331-b53a-1ce920bb953e service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:10.655801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5c50-f113-4331-b53a-1ce920bb953e service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:10.656066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f5c50-f113-4331-b53a-1ce920bb953e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:10.664780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f5c50-f113-4331-b53a-1ce920bb953e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:10.666369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f5c50-f113-4331-b53a-1ce920bb953e service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:10.675384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 682/1362] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:12.130053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d3176-b2e1-4712-b790-d6258cf79e55 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:12.130614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d3176-b2e1-4712-b790-d6258cf79e55 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:12.130614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89d3176-b2e1-4712-b790-d6258cf79e55 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:12.132391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 681/1363] 10.222.0.32 () {54 vars in 911 bytes} [Wed Oct 27 01:13:12 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:13:12.137739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890fe14-a8dd-47dd-b0c0-1c8e3475a60e None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:12.138146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890fe14-a8dd-47dd-b0c0-1c8e3475a60e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:12.138301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890fe14-a8dd-47dd-b0c0-1c8e3475a60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:12.155792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d890fe14-a8dd-47dd-b0c0-1c8e3475a60e None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:12.156953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d890fe14-a8dd-47dd-b0c0-1c8e3475a60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:12.165258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 683/1364] 10.222.0.32 () {58 vars in 1008 bytes} [Wed Oct 27 01:13:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:12.318536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d3176-b2e1-4712-b790-d6258cf79e55 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:12.332213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89d3176-b2e1-4712-b790-d6258cf79e55 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:12.338281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc85bf5d-b072-4870-83ed-bd652e92cec4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:12.338934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85bf5d-b072-4870-83ed-bd652e92cec4 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:12.339215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85bf5d-b072-4870-83ed-bd652e92cec4 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:12.339486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc85bf5d-b072-4870-83ed-bd652e92cec4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:12.347225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85bf5d-b072-4870-83ed-bd652e92cec4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:12.348783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc85bf5d-b072-4870-83ed-bd652e92cec4 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:12.358387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 682/1365] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:13.810064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccda9c0-151f-4fbf-9dc0-16df44b077ec None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:13.810608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccda9c0-151f-4fbf-9dc0-16df44b077ec None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:13.810608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccda9c0-151f-4fbf-9dc0-16df44b077ec None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:13.812362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 684/1366] 10.222.0.32 () {54 vars in 911 bytes} [Wed Oct 27 01:13:13 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:13.817843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7a0da-1d62-4da8-881a-16aae372a3cd None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:13.818360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7a0da-1d62-4da8-881a-16aae372a3cd None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:13.818551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa7a0da-1d62-4da8-881a-16aae372a3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:13.836212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-7fa7a0da-1d62-4da8-881a-16aae372a3cd None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:13.837372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7fa7a0da-1d62-4da8-881a-16aae372a3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:13.844934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 683/1367] 10.222.0.32 () {58 vars in 1008 bytes} [Wed Oct 27 01:13:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:13.996342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccda9c0-151f-4fbf-9dc0-16df44b077ec None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:14.011526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccda9c0-151f-4fbf-9dc0-16df44b077ec None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:14.016999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1150f66-e858-46dc-a42e-9ff63c0eff23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:14.017633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1150f66-e858-46dc-a42e-9ff63c0eff23 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:14.017909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1150f66-e858-46dc-a42e-9ff63c0eff23 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:14.018217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1150f66-e858-46dc-a42e-9ff63c0eff23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:14.026473 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1150f66-e858-46dc-a42e-9ff63c0eff23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:14.028014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1150f66-e858-46dc-a42e-9ff63c0eff23 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:14.037441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 685/1368] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:15.488106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f974-bf1b-45f4-b528-62c931a06aa2 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:15.488701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f974-bf1b-45f4-b528-62c931a06aa2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:15.488701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6f974-bf1b-45f4-b528-62c931a06aa2 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:15.491021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 684/1369] 10.222.0.32 () {54 vars in 911 bytes} [Wed Oct 27 01:13:15 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:15.496490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24087dc4-2cd8-4e9e-a61b-564be82e68ff None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:15.496934 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24087dc4-2cd8-4e9e-a61b-564be82e68ff None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:15.497038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24087dc4-2cd8-4e9e-a61b-564be82e68ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:15.514921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-24087dc4-2cd8-4e9e-a61b-564be82e68ff None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:15.516086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-24087dc4-2cd8-4e9e-a61b-564be82e68ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:15.524153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 686/1370] 10.222.0.32 () {58 vars in 1008 bytes} [Wed Oct 27 01:13:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:15.677018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6f974-bf1b-45f4-b528-62c931a06aa2 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:15.690815 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a6f974-bf1b-45f4-b528-62c931a06aa2 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:15.696594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739ca54-195b-43b9-92f8-8fb119969f68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:15.697216 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ca54-195b-43b9-92f8-8fb119969f68 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:15.697491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ca54-195b-43b9-92f8-8fb119969f68 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:15.697760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739ca54-195b-43b9-92f8-8fb119969f68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:15.705529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739ca54-195b-43b9-92f8-8fb119969f68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:15.707107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739ca54-195b-43b9-92f8-8fb119969f68 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:15.717069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 685/1371] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:17.195012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135048d-9cfc-484f-b256-db562cfb0fcf None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:17.195587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135048d-9cfc-484f-b256-db562cfb0fcf None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:17.195587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135048d-9cfc-484f-b256-db562cfb0fcf None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:17.197302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 687/1372] 10.222.0.32 () {54 vars in 911 bytes} [Wed Oct 27 01:13:17 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:17.202790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124a8e-3d61-4f87-8d99-75e517c5a4f3 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:17.203189 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124a8e-3d61-4f87-8d99-75e517c5a4f3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:17.203345 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93124a8e-3d61-4f87-8d99-75e517c5a4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:17.221639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-93124a8e-3d61-4f87-8d99-75e517c5a4f3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:17.222994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-93124a8e-3d61-4f87-8d99-75e517c5a4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:17.231177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 686/1373] 10.222.0.32 () {58 vars in 1008 bytes} [Wed Oct 27 01:13:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:17.385853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135048d-9cfc-484f-b256-db562cfb0fcf None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:17.400411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135048d-9cfc-484f-b256-db562cfb0fcf None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:17.405792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603416c-050e-441c-868e-484dc3327a6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:17.406442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603416c-050e-441c-868e-484dc3327a6a service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:17.406718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603416c-050e-441c-868e-484dc3327a6a service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:17.406984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603416c-050e-441c-868e-484dc3327a6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:17.414932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603416c-050e-441c-868e-484dc3327a6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:17.416483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603416c-050e-441c-868e-484dc3327a6a service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:17.425512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 688/1374] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:17 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:18.900662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450d42-7d4e-4a17-b262-3307bd68313e None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:18.901205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450d42-7d4e-4a17-b262-3307bd68313e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:18.901205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e450d42-7d4e-4a17-b262-3307bd68313e None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:18.903140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 687/1375] 10.222.0.32 () {54 vars in 911 bytes} [Wed Oct 27 01:13:18 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:18.908575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796cb83-44a2-47f1-bf81-1856d68d2bf9 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:18.908987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796cb83-44a2-47f1-bf81-1856d68d2bf9 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:18.909122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0796cb83-44a2-47f1-bf81-1856d68d2bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:18.926258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0796cb83-44a2-47f1-bf81-1856d68d2bf9 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:18.927971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0796cb83-44a2-47f1-bf81-1856d68d2bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:18.935718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 689/1376] 10.222.0.32 () {58 vars in 1008 bytes} [Wed Oct 27 01:13:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:19.095982 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450d42-7d4e-4a17-b262-3307bd68313e None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:19.110142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e450d42-7d4e-4a17-b262-3307bd68313e None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:19.115887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de714fa-0efa-4a4a-9310-320ecf368b38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:19.116559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de714fa-0efa-4a4a-9310-320ecf368b38 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:19.116837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de714fa-0efa-4a4a-9310-320ecf368b38 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:19.117132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de714fa-0efa-4a4a-9310-320ecf368b38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:19.125330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de714fa-0efa-4a4a-9310-320ecf368b38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:19.126989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de714fa-0efa-4a4a-9310-320ecf368b38 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:19.136586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 688/1377] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:20.598437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dd32-ca72-4abc-8171-4226d6d745d3 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:20.599550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dd32-ca72-4abc-8171-4226d6d745d3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:20.599550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a6dd32-ca72-4abc-8171-4226d6d745d3 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:20.601454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 690/1378] 10.222.0.32 () {54 vars in 911 bytes} [Wed Oct 27 01:13:20 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:20.606951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551d69d-064f-47c2-8b82-ebaf727729e0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:20.607387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551d69d-064f-47c2-8b82-ebaf727729e0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:20.607501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9551d69d-064f-47c2-8b82-ebaf727729e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:20.624870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9551d69d-064f-47c2-8b82-ebaf727729e0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:20.626066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9551d69d-064f-47c2-8b82-ebaf727729e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:20.633860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 689/1379] 10.222.0.32 () {58 vars in 1008 bytes} [Wed Oct 27 01:13:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:20.787350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6dd32-ca72-4abc-8171-4226d6d745d3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:20.801707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a6dd32-ca72-4abc-8171-4226d6d745d3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:20.807190 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc131b-b7b6-403f-bf0b-74df0f5754d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:20.807839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc131b-b7b6-403f-bf0b-74df0f5754d7 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:20.808118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc131b-b7b6-403f-bf0b-74df0f5754d7 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:20.808386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc131b-b7b6-403f-bf0b-74df0f5754d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:20.816282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc131b-b7b6-403f-bf0b-74df0f5754d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:20.818445 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fc131b-b7b6-403f-bf0b-74df0f5754d7 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:20.827539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 691/1380] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:22.315376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac21ca-89e6-441f-b533-fb829379df17 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:22.315916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac21ca-89e6-441f-b533-fb829379df17 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:22.315916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac21ca-89e6-441f-b533-fb829379df17 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:22.317647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 690/1381] 10.222.0.32 () {54 vars in 911 bytes} [Wed Oct 27 01:13:22 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:22.323405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dff129-89fe-49ac-8f93-8d49810c3dfb None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:22.323855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dff129-89fe-49ac-8f93-8d49810c3dfb None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:22.323977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dff129-89fe-49ac-8f93-8d49810c3dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:22.341780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d7dff129-89fe-49ac-8f93-8d49810c3dfb None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:22.343014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d7dff129-89fe-49ac-8f93-8d49810c3dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:22.351709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 692/1382] 10.222.0.32 () {58 vars in 1008 bytes} [Wed Oct 27 01:13:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:13:22.513163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac21ca-89e6-441f-b533-fb829379df17 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:22.527330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac21ca-89e6-441f-b533-fb829379df17 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:22.532616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f3618-e902-4c47-b4de-87e6eb94ca05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:22.533246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f3618-e902-4c47-b4de-87e6eb94ca05 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:22.533527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f3618-e902-4c47-b4de-87e6eb94ca05 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:22.533805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f3618-e902-4c47-b4de-87e6eb94ca05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:22.542561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f3618-e902-4c47-b4de-87e6eb94ca05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:22.544318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816f3618-e902-4c47-b4de-87e6eb94ca05 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:22.554276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 691/1383] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:24.692787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c19e9-eefc-4329-8d0c-3f28e3d0e1a7 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:24.693375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c19e9-eefc-4329-8d0c-3f28e3d0e1a7 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:24.693375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c19e9-eefc-4329-8d0c-3f28e3d0e1a7 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:24.695147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 693/1384] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:24 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:24.700991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3585f13-5350-4267-8126-f275ac1d27cb None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:24.701394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3585f13-5350-4267-8126-f275ac1d27cb None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:24.701531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3585f13-5350-4267-8126-f275ac1d27cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:24.719469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c3585f13-5350-4267-8126-f275ac1d27cb None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:24.720651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c3585f13-5350-4267-8126-f275ac1d27cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:24.729276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 692/1385] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:13:24.769533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c19e9-eefc-4329-8d0c-3f28e3d0e1a7 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:24.779925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c19e9-eefc-4329-8d0c-3f28e3d0e1a7 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:24.783360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3455204d-5f86-46cf-aebf-9b477c4c98b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:24.783974 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455204d-5f86-46cf-aebf-9b477c4c98b3 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:24.784247 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455204d-5f86-46cf-aebf-9b477c4c98b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:24.784514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3455204d-5f86-46cf-aebf-9b477c4c98b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:24.793853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455204d-5f86-46cf-aebf-9b477c4c98b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:24.795286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3455204d-5f86-46cf-aebf-9b477c4c98b3 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:24.804840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 694/1386] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:27.234285 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f9be3-a0b7-4533-9170-b99d1690008d None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:27.234799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f9be3-a0b7-4533-9170-b99d1690008d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:27.234914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458f9be3-a0b7-4533-9170-b99d1690008d None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:27.236700 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 693/1387] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:27 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:27.243217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c38cb5-f042-4361-9c12-e556ecdcd081 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:27.243650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c38cb5-f042-4361-9c12-e556ecdcd081 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:27.243789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c38cb5-f042-4361-9c12-e556ecdcd081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:27.261918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-49c38cb5-f042-4361-9c12-e556ecdcd081 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:27.263045 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-49c38cb5-f042-4361-9c12-e556ecdcd081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:27.270588 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 695/1388] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:27.310371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f9be3-a0b7-4533-9170-b99d1690008d None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:27.321604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458f9be3-a0b7-4533-9170-b99d1690008d None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:27.325049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489f234b-e667-43b1-afca-8996576ae972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:27.325668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f234b-e667-43b1-afca-8996576ae972 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:27.325942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f234b-e667-43b1-afca-8996576ae972 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:27.326240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489f234b-e667-43b1-afca-8996576ae972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:27.335006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f234b-e667-43b1-afca-8996576ae972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:27.336436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489f234b-e667-43b1-afca-8996576ae972 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:27.345376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 694/1389] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:29.985798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d80ff-bdd7-4e7c-833d-9cdb05739ae1 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:29.986440 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d80ff-bdd7-4e7c-833d-9cdb05739ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:29.986545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2d80ff-bdd7-4e7c-833d-9cdb05739ae1 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:29.988310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 696/1390] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:29 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:29.995146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689afc9-5e91-4452-97c7-6c89d1cbad9c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:29.995604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689afc9-5e91-4452-97c7-6c89d1cbad9c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:29.995800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689afc9-5e91-4452-97c7-6c89d1cbad9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:30.013141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-3689afc9-5e91-4452-97c7-6c89d1cbad9c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:30.014357 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3689afc9-5e91-4452-97c7-6c89d1cbad9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:30.022548 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 695/1391] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:30.062861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d80ff-bdd7-4e7c-833d-9cdb05739ae1 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:30.073135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2d80ff-bdd7-4e7c-833d-9cdb05739ae1 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:30.076800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693b4547-1210-4cd9-8eec-51fd6a0ebd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:30.077426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b4547-1210-4cd9-8eec-51fd6a0ebd0e service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:30.077697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b4547-1210-4cd9-8eec-51fd6a0ebd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:30.077992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693b4547-1210-4cd9-8eec-51fd6a0ebd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:30.087060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b4547-1210-4cd9-8eec-51fd6a0ebd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:30.088448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693b4547-1210-4cd9-8eec-51fd6a0ebd0e service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:30.097340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 697/1392] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:30 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:32.464454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9d941-a79d-43df-9369-8ad090b1d63d None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:32.465025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9d941-a79d-43df-9369-8ad090b1d63d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:32.465131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9d941-a79d-43df-9369-8ad090b1d63d None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:32.466882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 696/1393] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:32 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:32.472896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89242b41-bcc7-41ce-9dac-2b3629822f3c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:32.473296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89242b41-bcc7-41ce-9dac-2b3629822f3c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:32.473557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89242b41-bcc7-41ce-9dac-2b3629822f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:32.491582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-89242b41-bcc7-41ce-9dac-2b3629822f3c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:32.492755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-89242b41-bcc7-41ce-9dac-2b3629822f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:32.500965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 698/1394] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:32.540724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9d941-a79d-43df-9369-8ad090b1d63d None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:32.551143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9d941-a79d-43df-9369-8ad090b1d63d None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:32.555493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36440b5c-25bc-4336-8262-58dd5bd4a665 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:32.556121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36440b5c-25bc-4336-8262-58dd5bd4a665 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:32.556397 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36440b5c-25bc-4336-8262-58dd5bd4a665 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:32.556665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36440b5c-25bc-4336-8262-58dd5bd4a665 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:32.565132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36440b5c-25bc-4336-8262-58dd5bd4a665 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:32.566649 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36440b5c-25bc-4336-8262-58dd5bd4a665 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:32.580538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 697/1395] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:34.880716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006c1de-008d-49db-bcf5-c5c0fe079513 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:34.881312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006c1de-008d-49db-bcf5-c5c0fe079513 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:34.881312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006c1de-008d-49db-bcf5-c5c0fe079513 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:34.883106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 699/1396] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:34 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:34.889027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7333-a0fb-4360-ba72-b249d29e68d3 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:34.889443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7333-a0fb-4360-ba72-b249d29e68d3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:34.889574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c7333-a0fb-4360-ba72-b249d29e68d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:34.907442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-599c7333-a0fb-4360-ba72-b249d29e68d3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:34.908611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-599c7333-a0fb-4360-ba72-b249d29e68d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:34.917012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 698/1397] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:34.956606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006c1de-008d-49db-bcf5-c5c0fe079513 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:34.958838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2006c1de-008d-49db-bcf5-c5c0fe079513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:34.971279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006c1de-008d-49db-bcf5-c5c0fe079513 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:34.975381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5ca00a-923c-4a6f-9f5c-c7450bb567d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:34.975996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ca00a-923c-4a6f-9f5c-c7450bb567d0 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:34.976273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ca00a-923c-4a6f-9f5c-c7450bb567d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:34.976543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5ca00a-923c-4a6f-9f5c-c7450bb567d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:34.985218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ca00a-923c-4a6f-9f5c-c7450bb567d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:34.986657 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5ca00a-923c-4a6f-9f5c-c7450bb567d0 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:34.996198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 700/1398] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:37.310626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b89545-9c9b-4fde-aedb-2c7ca8ce1c5a None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:37.311188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b89545-9c9b-4fde-aedb-2c7ca8ce1c5a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:37.311188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b89545-9c9b-4fde-aedb-2c7ca8ce1c5a None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:37.312927 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 699/1399] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:37.319318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea941a13-de20-49d4-951f-50c946ce93a0 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:37.319778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea941a13-de20-49d4-951f-50c946ce93a0 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:37.319886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea941a13-de20-49d4-951f-50c946ce93a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:37.337760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ea941a13-de20-49d4-951f-50c946ce93a0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:37.338973 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ea941a13-de20-49d4-951f-50c946ce93a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:37.346556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 701/1400] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:13:37.386000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b89545-9c9b-4fde-aedb-2c7ca8ce1c5a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:37.396806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b89545-9c9b-4fde-aedb-2c7ca8ce1c5a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:37.400203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f0e7d-dde2-4c6f-b749-15efb0542f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:37.400831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f0e7d-dde2-4c6f-b749-15efb0542f9b service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:37.401105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f0e7d-dde2-4c6f-b749-15efb0542f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:37.401374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f0e7d-dde2-4c6f-b749-15efb0542f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:37.409947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f0e7d-dde2-4c6f-b749-15efb0542f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:37.411575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f0e7d-dde2-4c6f-b749-15efb0542f9b service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:37.420618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 700/1401] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:39.760616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6cd42-c360-4529-b00b-87b10e41c01b None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:39.761185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6cd42-c360-4529-b00b-87b10e41c01b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:39.761185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6cd42-c360-4529-b00b-87b10e41c01b None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:39.763042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 702/1402] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:39 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:39.769005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b17fa5-d72c-4a69-b056-07744aa60b7d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:39.769453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b17fa5-d72c-4a69-b056-07744aa60b7d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:39.769565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b17fa5-d72c-4a69-b056-07744aa60b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:39.788397 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-18b17fa5-d72c-4a69-b056-07744aa60b7d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:39.789579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-18b17fa5-d72c-4a69-b056-07744aa60b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:39.797220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 701/1403] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:39.837148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6cd42-c360-4529-b00b-87b10e41c01b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:39.849526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6cd42-c360-4529-b00b-87b10e41c01b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:39.854159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389becd-79b2-448d-8be6-53ac0f33393c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:39.854789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389becd-79b2-448d-8be6-53ac0f33393c service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:39.855066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389becd-79b2-448d-8be6-53ac0f33393c service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:39.855337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389becd-79b2-448d-8be6-53ac0f33393c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:39.865168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389becd-79b2-448d-8be6-53ac0f33393c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:39.866654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389becd-79b2-448d-8be6-53ac0f33393c service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:39.875984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 703/1404] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:42.227184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01025-27b2-4af3-85d5-a1e6ea977f28 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:42.234401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01025-27b2-4af3-85d5-a1e6ea977f28 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:42.234401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d01025-27b2-4af3-85d5-a1e6ea977f28 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:42.234401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 702/1405] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:42 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:42.235638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b4951-6747-4244-9f69-e32740ca148b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:42.236046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b4951-6747-4244-9f69-e32740ca148b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:42.236185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b4951-6747-4244-9f69-e32740ca148b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:42.254867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-177b4951-6747-4244-9f69-e32740ca148b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:42.256057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-177b4951-6747-4244-9f69-e32740ca148b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:42.263723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 704/1406] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:42.302571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01025-27b2-4af3-85d5-a1e6ea977f28 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:42.312802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d01025-27b2-4af3-85d5-a1e6ea977f28 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:42.316206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1c73e-6e4f-441c-9600-d5ab34043f0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:42.317524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1c73e-6e4f-441c-9600-d5ab34043f0b service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:42.317800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1c73e-6e4f-441c-9600-d5ab34043f0b service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:42.318107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1c73e-6e4f-441c-9600-d5ab34043f0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:42.326642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1c73e-6e4f-441c-9600-d5ab34043f0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:42.328049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1c73e-6e4f-441c-9600-d5ab34043f0b service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:42.337063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 703/1407] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:13:44.599574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53382aa4-b434-47a6-9ee3-24f758d2db4f None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:44.600145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53382aa4-b434-47a6-9ee3-24f758d2db4f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:44.600145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53382aa4-b434-47a6-9ee3-24f758d2db4f None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:44.601893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 705/1408] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:44 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:44.607942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf0aee-179c-4504-9355-485899332aef None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:44.608402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf0aee-179c-4504-9355-485899332aef None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:44.608499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf0aee-179c-4504-9355-485899332aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:44.626168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-32bf0aee-179c-4504-9355-485899332aef None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:44.627349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-32bf0aee-179c-4504-9355-485899332aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:44.635391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 704/1409] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:44.673697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53382aa4-b434-47a6-9ee3-24f758d2db4f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:44.685940 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53382aa4-b434-47a6-9ee3-24f758d2db4f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:44.689407 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4dde4d-9f82-4ebf-b15b-7ed748d5f710 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:44.690047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dde4d-9f82-4ebf-b15b-7ed748d5f710 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:44.690336 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dde4d-9f82-4ebf-b15b-7ed748d5f710 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:44.690601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4dde4d-9f82-4ebf-b15b-7ed748d5f710 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:44.699210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4dde4d-9f82-4ebf-b15b-7ed748d5f710 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:44.700604 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4dde4d-9f82-4ebf-b15b-7ed748d5f710 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:44.710292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 706/1410] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:13:46.965850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6851f48-13c4-4347-af97-37271baafa11 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:46.966522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6851f48-13c4-4347-af97-37271baafa11 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:46.966522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6851f48-13c4-4347-af97-37271baafa11 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:46.968203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 705/1411] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:13:46 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:13:46.974134 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05457fa6-de16-4dc8-8a22-acea1f9679dd None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:46.974556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05457fa6-de16-4dc8-8a22-acea1f9679dd None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:46.974660 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05457fa6-de16-4dc8-8a22-acea1f9679dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:46.992696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-05457fa6-de16-4dc8-8a22-acea1f9679dd None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:13:46.993864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-05457fa6-de16-4dc8-8a22-acea1f9679dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:13:47.001766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 707/1412] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:13:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:13:47.040145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6851f48-13c4-4347-af97-37271baafa11 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:13:47.050622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6851f48-13c4-4347-af97-37271baafa11 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:13:47.054692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd89ae-ceec-48eb-8915-908f63b85a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:13:47.055339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd89ae-ceec-48eb-8915-908f63b85a99 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:13:47.055615 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd89ae-ceec-48eb-8915-908f63b85a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:13:47.055886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd89ae-ceec-48eb-8915-908f63b85a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:13:47.064436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd89ae-ceec-48eb-8915-908f63b85a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:13:47.065847 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd89ae-ceec-48eb-8915-908f63b85a99 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:13:47.075364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 706/1413] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:13:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:14:04.129754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b8bd8-3018-477d-bc42-de62421f0a8c None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:04.130373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b8bd8-3018-477d-bc42-de62421f0a8c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:04.130373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376b8bd8-3018-477d-bc42-de62421f0a8c None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:04.132098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 708/1414] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:14:04 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:04.137753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49072f-75d6-4953-ac51-4cdf5f0b6ba6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:04.138232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49072f-75d6-4953-ac51-4cdf5f0b6ba6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:04.138380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a49072f-75d6-4953-ac51-4cdf5f0b6ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:04.155675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5a49072f-75d6-4953-ac51-4cdf5f0b6ba6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:04.156841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5a49072f-75d6-4953-ac51-4cdf5f0b6ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:04.164706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 707/1415] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:14:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:14:04.215433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f46353-5342-419a-abc4-0e994b6cfb2c None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:04.215715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f46353-5342-419a-abc4-0e994b6cfb2c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:04.215987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f46353-5342-419a-abc4-0e994b6cfb2c None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:04.217749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 709/1416] 10.222.0.32 () {54 vars in 962 bytes} [Wed Oct 27 01:14:04 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:04.223054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ff9b1-150b-40f2-a4f7-463e288feffb None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:04.223341 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ff9b1-150b-40f2-a4f7-463e288feffb None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:04.223616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ff9b1-150b-40f2-a4f7-463e288feffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:04.241794 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d78ff9b1-150b-40f2-a4f7-463e288feffb None None] MFA Rules not processed for user `9f402e17093e4e99afda5ea019f335eb`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:04.242993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d78ff9b1-150b-40f2-a4f7-463e288feffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:04.249495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 708/1417] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Oct 27 01:14:04 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:14:04.257830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f46353-5342-419a-abc4-0e994b6cfb2c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:04.268023 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f46353-5342-419a-abc4-0e994b6cfb2c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:04.271521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fef3c7c-0031-476e-a1b4-77abdbe5c634 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f402e17093e4e99afda5ea019f335eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:04.272137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3c7c-0031-476e-a1b4-77abdbe5c634 service glance] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:04.272413 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3c7c-0031-476e-a1b4-77abdbe5c634 service glance] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:04.272683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fef3c7c-0031-476e-a1b4-77abdbe5c634 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:04.281123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef3c7c-0031-476e-a1b4-77abdbe5c634 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:04.282563 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fef3c7c-0031-476e-a1b4-77abdbe5c634 service glance] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:04.291970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 710/1418] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:14:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:14:06.742495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398264-398b-4b24-b8cf-4261b0a19546 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:06.743065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398264-398b-4b24-b8cf-4261b0a19546 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:06.743065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99398264-398b-4b24-b8cf-4261b0a19546 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:06.744820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 709/1419] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:14:06 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:06.750932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588023-4876-4518-bff7-560acd4bf396 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:06.751375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588023-4876-4518-bff7-560acd4bf396 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:06.751479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e588023-4876-4518-bff7-560acd4bf396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:06.770123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-9e588023-4876-4518-bff7-560acd4bf396 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:06.771313 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-9e588023-4876-4518-bff7-560acd4bf396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:06.778942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 711/1420] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:14:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:14:06.803362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398264-398b-4b24-b8cf-4261b0a19546 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:06.815341 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99398264-398b-4b24-b8cf-4261b0a19546 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:06.820323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e739939-52b2-4c5f-96b1-e01767efca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:06.820952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e739939-52b2-4c5f-96b1-e01767efca1c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:06.821227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e739939-52b2-4c5f-96b1-e01767efca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:06.821491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e739939-52b2-4c5f-96b1-e01767efca1c admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:06.822246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e739939-52b2-4c5f-96b1-e01767efca1c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:06.824052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e739939-52b2-4c5f-96b1-e01767efca1c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:06.837576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 710/1421] 10.222.0.32 () {56 vars in 1108 bytes} [Wed Oct 27 01:14:06 2021] GET /identity/v3/projects => generated 2553 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:14:09.106706 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143233f6-0a31-491b-8fef-d335f4e41b64 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:09.107257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143233f6-0a31-491b-8fef-d335f4e41b64 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:09.107257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143233f6-0a31-491b-8fef-d335f4e41b64 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:09.109005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 712/1422] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:14:09 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:09.114961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4493c1-b51e-4760-afb3-445dc7451fc3 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:09.115390 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4493c1-b51e-4760-afb3-445dc7451fc3 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:09.115518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4493c1-b51e-4760-afb3-445dc7451fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:09.133857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-7b4493c1-b51e-4760-afb3-445dc7451fc3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:09.135064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7b4493c1-b51e-4760-afb3-445dc7451fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:09.143095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 711/1423] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:14:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:14:09.187968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143233f6-0a31-491b-8fef-d335f4e41b64 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:09.202982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143233f6-0a31-491b-8fef-d335f4e41b64 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:09.208759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fd04ac-77ee-4f68-bad4-0ddc07419e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:09.209388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd04ac-77ee-4f68-bad4-0ddc07419e35 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:09.209667 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd04ac-77ee-4f68-bad4-0ddc07419e35 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:09.209942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fd04ac-77ee-4f68-bad4-0ddc07419e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:09.217882 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd04ac-77ee-4f68-bad4-0ddc07419e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:09.219512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fd04ac-77ee-4f68-bad4-0ddc07419e35 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:09.228928 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 713/1424] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:14:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:14:11.663465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741e48-07fb-4891-b8f7-86d07526755d None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:11.664013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741e48-07fb-4891-b8f7-86d07526755d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:11.664013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad741e48-07fb-4891-b8f7-86d07526755d None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:11.665800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 712/1425] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:14:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:11.671754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5991af2-476f-4f40-b160-e08acb5a25e2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:11.672187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5991af2-476f-4f40-b160-e08acb5a25e2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:11.672326 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5991af2-476f-4f40-b160-e08acb5a25e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:11.689416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c5991af2-476f-4f40-b160-e08acb5a25e2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:11.691019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c5991af2-476f-4f40-b160-e08acb5a25e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:11.698540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 714/1426] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:14:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:14:11.736745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad741e48-07fb-4891-b8f7-86d07526755d None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:11.747496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad741e48-07fb-4891-b8f7-86d07526755d None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:11.751235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15592ee5-94b9-4b85-b8b2-9ad8d4252fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:11.751863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15592ee5-94b9-4b85-b8b2-9ad8d4252fdf service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:11.752142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15592ee5-94b9-4b85-b8b2-9ad8d4252fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:11.752415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15592ee5-94b9-4b85-b8b2-9ad8d4252fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:11.761828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15592ee5-94b9-4b85-b8b2-9ad8d4252fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:11.763306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15592ee5-94b9-4b85-b8b2-9ad8d4252fdf service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:11.773456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 713/1427] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:14:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:14:14.087174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5123d-77c5-401c-acdd-2272ffe1de52 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:14.087703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5123d-77c5-401c-acdd-2272ffe1de52 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:14.087703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5123d-77c5-401c-acdd-2272ffe1de52 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:14.089519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 715/1428] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:14:14 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:14.095613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c8eec-51cc-4118-b1a9-e32e529aa7ca None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:14.096035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c8eec-51cc-4118-b1a9-e32e529aa7ca None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:14.096144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6c8eec-51cc-4118-b1a9-e32e529aa7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:14.114936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4e6c8eec-51cc-4118-b1a9-e32e529aa7ca None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:14.116119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4e6c8eec-51cc-4118-b1a9-e32e529aa7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:14.123895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 714/1429] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:14:14 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:14:14.163901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5123d-77c5-401c-acdd-2272ffe1de52 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:14.174105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5123d-77c5-401c-acdd-2272ffe1de52 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:14.178106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3840c-b35b-434f-816a-4b5aad8d0a5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:14.178722 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3840c-b35b-434f-816a-4b5aad8d0a5c service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:14.178995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3840c-b35b-434f-816a-4b5aad8d0a5c service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:14.179261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3840c-b35b-434f-816a-4b5aad8d0a5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:14.187595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3840c-b35b-434f-816a-4b5aad8d0a5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:14.189023 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3840c-b35b-434f-816a-4b5aad8d0a5c service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:14.198040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 716/1430] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:14:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:14:16.628271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5dd4-2dbd-4220-9f58-62006c584a81 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:16.628859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5dd4-2dbd-4220-9f58-62006c584a81 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:16.628859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537e5dd4-2dbd-4220-9f58-62006c584a81 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:16.630678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 715/1431] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:14:16 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:16.636690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e720-d44d-456d-aeda-ef8c5bea7092 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:16.637122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e720-d44d-456d-aeda-ef8c5bea7092 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:16.637232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8e720-d44d-456d-aeda-ef8c5bea7092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:16.655544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-b9d8e720-d44d-456d-aeda-ef8c5bea7092 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:16.656724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b9d8e720-d44d-456d-aeda-ef8c5bea7092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:16.664978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 717/1432] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:14:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:14:16.707177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5dd4-2dbd-4220-9f58-62006c584a81 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:16.717620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537e5dd4-2dbd-4220-9f58-62006c584a81 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:16.721063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517281a-12a1-4276-9842-36d31c0df619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:16.722606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517281a-12a1-4276-9842-36d31c0df619 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:16.722912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517281a-12a1-4276-9842-36d31c0df619 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:16.723188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517281a-12a1-4276-9842-36d31c0df619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:16.731821 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517281a-12a1-4276-9842-36d31c0df619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:16.733242 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517281a-12a1-4276-9842-36d31c0df619 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:16.742644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 716/1433] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:14:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:14:19.362745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dd5ad-5460-4081-83a5-84fac3072d62 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:19.363265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dd5ad-5460-4081-83a5-84fac3072d62 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:19.363265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67dd5ad-5460-4081-83a5-84fac3072d62 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:19.366609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 718/1434] 10.222.0.32 () {54 vars in 926 bytes} [Wed Oct 27 01:14:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:14:19.373683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0a73-e9be-4262-a72a-5b07c35a76b2 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:19.373683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0a73-e9be-4262-a72a-5b07c35a76b2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:19.373683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d0a73-e9be-4262-a72a-5b07c35a76b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:19.391478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-337d0a73-e9be-4262-a72a-5b07c35a76b2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:14:19.392731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-337d0a73-e9be-4262-a72a-5b07c35a76b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:14:19.401148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 717/1435] 10.222.0.32 () {58 vars in 1023 bytes} [Wed Oct 27 01:14:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:14:19.441948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dd5ad-5460-4081-83a5-84fac3072d62 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:14:19.452285 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67dd5ad-5460-4081-83a5-84fac3072d62 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:14:19.456413 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a79ac84-6f3a-470d-aa88-1b2d6ad7d822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:14:19.457034 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79ac84-6f3a-470d-aa88-1b2d6ad7d822 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:14:19.457303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79ac84-6f3a-470d-aa88-1b2d6ad7d822 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:14:19.457567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a79ac84-6f3a-470d-aa88-1b2d6ad7d822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:14:19.466158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79ac84-6f3a-470d-aa88-1b2d6ad7d822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:14:19.467607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a79ac84-6f3a-470d-aa88-1b2d6ad7d822 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:14:19.476609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 719/1436] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:14:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:15:38.480206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62ccd8-0c91-406d-b1cc-ba449df2332f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.480825 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62ccd8-0c91-406d-b1cc-ba449df2332f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.480825 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d62ccd8-0c91-406d-b1cc-ba449df2332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.500081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9d62ccd8-0c91-406d-b1cc-ba449df2332f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:38.501247 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9d62ccd8-0c91-406d-b1cc-ba449df2332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:38.508746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 718/1437] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:15:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:38.517082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658da482-56da-4827-82e8-cdab4d6ac306 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.517578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658da482-56da-4827-82e8-cdab4d6ac306 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.517689 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658da482-56da-4827-82e8-cdab4d6ac306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.536984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-658da482-56da-4827-82e8-cdab4d6ac306 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:38.538173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-658da482-56da-4827-82e8-cdab4d6ac306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:38.546236 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 720/1438] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:15:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:38.550774 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62ccd8-0c91-406d-b1cc-ba449df2332f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:38.562209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d62ccd8-0c91-406d-b1cc-ba449df2332f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:38.566688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7cef4-406f-4e3a-9f1c-ed1f0c1d8af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:38.567325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7cef4-406f-4e3a-9f1c-ed1f0c1d8af9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.567601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7cef4-406f-4e3a-9f1c-ed1f0c1d8af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.567869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc7cef4-406f-4e3a-9f1c-ed1f0c1d8af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.568594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7cef4-406f-4e3a-9f1c-ed1f0c1d8af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:15:38.568893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7cef4-406f-4e3a-9f1c-ed1f0c1d8af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:38.570487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc7cef4-406f-4e3a-9f1c-ed1f0c1d8af9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:38.582272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 719/1439] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:15:38 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:15:38.590108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658da482-56da-4827-82e8-cdab4d6ac306 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:38.598917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658da482-56da-4827-82e8-cdab4d6ac306 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:38.604094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5ced1-8e6c-45fa-ba9b-c25f2d7377c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:38.604742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ced1-8e6c-45fa-ba9b-c25f2d7377c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.605020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ced1-8e6c-45fa-ba9b-c25f2d7377c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.605295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc5ced1-8e6c-45fa-ba9b-c25f2d7377c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.606046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5ced1-8e6c-45fa-ba9b-c25f2d7377c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:38.608523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc5ced1-8e6c-45fa-ba9b-c25f2d7377c0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:38.712015 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 721/1440] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:15:38 2021] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:15:38.716121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7cef4-406f-4e3a-9f1c-ed1f0c1d8af9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:38.726169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc7cef4-406f-4e3a-9f1c-ed1f0c1d8af9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:38.780747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de321c34-acc3-413f-8abc-eda11597df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:38.781328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de321c34-acc3-413f-8abc-eda11597df87 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.781661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de321c34-acc3-413f-8abc-eda11597df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.781935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de321c34-acc3-413f-8abc-eda11597df87 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.782653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de321c34-acc3-413f-8abc-eda11597df87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:38.784547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de321c34-acc3-413f-8abc-eda11597df87 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:38.871038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 720/1441] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:15:38 2021] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:15:38.875186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5ced1-8e6c-45fa-ba9b-c25f2d7377c0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:38.885000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc5ced1-8e6c-45fa-ba9b-c25f2d7377c0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:38.889431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473a579-b0db-439a-b157-61818e247623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:38.890107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473a579-b0db-439a-b157-61818e247623 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.890387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473a579-b0db-439a-b157-61818e247623 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.890656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473a579-b0db-439a-b157-61818e247623 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.891404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473a579-b0db-439a-b157-61818e247623 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:38.893081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473a579-b0db-439a-b157-61818e247623 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:38.905956 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 722/1442] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:15:38 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:15:38.909768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de321c34-acc3-413f-8abc-eda11597df87 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:38.919482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de321c34-acc3-413f-8abc-eda11597df87 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:38.924590 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3c1fa9-5e9f-4f39-b21f-0abfe32c1323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:38.925241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c1fa9-5e9f-4f39-b21f-0abfe32c1323 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.925522 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c1fa9-5e9f-4f39-b21f-0abfe32c1323 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.925796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3c1fa9-5e9f-4f39-b21f-0abfe32c1323 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.926558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c1fa9-5e9f-4f39-b21f-0abfe32c1323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:38.928127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3c1fa9-5e9f-4f39-b21f-0abfe32c1323 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:38.940975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 721/1443] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:15:38 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:15:38.944987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473a579-b0db-439a-b157-61818e247623 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:38.954579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473a579-b0db-439a-b157-61818e247623 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:38.959020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0c667-9a04-471e-86eb-5339cd6f98ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:38.959885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0c667-9a04-471e-86eb-5339cd6f98ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:38.960165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0c667-9a04-471e-86eb-5339cd6f98ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:38.960433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0c667-9a04-471e-86eb-5339cd6f98ec admin admin] PATH_INFO: `/v3/projects/d5626034fc5147219eb2995c293cfe54/users/11b35c0e8dd6466fa1111ef4f373d9cb/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:38.974904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0c667-9a04-471e-86eb-5339cd6f98ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5626034fc5147219eb2995c293cfe54, user_id=11b35c0e8dd6466fa1111ef4f373d9cb, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:38.977489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0c667-9a04-471e-86eb-5339cd6f98ec admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:39.073110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 723/1444] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:15:38 2021] PUT /identity/v3/projects/d5626034fc5147219eb2995c293cfe54/users/11b35c0e8dd6466fa1111ef4f373d9cb/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:15:39.085052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec4407-bae3-4557-95b8-ab54596dea84 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:39.085359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec4407-bae3-4557-95b8-ab54596dea84 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:39.085636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec4407-bae3-4557-95b8-ab54596dea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:39.112435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-a2ec4407-bae3-4557-95b8-ab54596dea84 None None] MFA Rules not processed for user `11b35c0e8dd6466fa1111ef4f373d9cb`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:39.113941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a2ec4407-bae3-4557-95b8-ab54596dea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:39.174323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 722/1445] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:15:39 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:39.185471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0c667-9a04-471e-86eb-5339cd6f98ec admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:39.253293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0c667-9a04-471e-86eb-5339cd6f98ec admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:39.258702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146e602-996a-477e-9a0e-a5c1676508b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:39.259370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e602-996a-477e-9a0e-a5c1676508b9 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:39.259727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e602-996a-477e-9a0e-a5c1676508b9 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:39.259913 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146e602-996a-477e-9a0e-a5c1676508b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:39.268379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146e602-996a-477e-9a0e-a5c1676508b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:39.272600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6146e602-996a-477e-9a0e-a5c1676508b9 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:39.279002 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 724/1446] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:15:39 2021] GET /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:15:39.352696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb1ba3-2d18-4de1-b959-00c589288da2 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:39.352980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb1ba3-2d18-4de1-b959-00c589288da2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:39.353253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bb1ba3-2d18-4de1-b959-00c589288da2 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:39.354974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 723/1447] 10.222.0.32 () {52 vars in 829 bytes} [Wed Oct 27 01:15:39 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:15:39.358821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146e602-996a-477e-9a0e-a5c1676508b9 service nova] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:39.418269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146e602-996a-477e-9a0e-a5c1676508b9 service nova] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:39.423449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:39.424324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:39.424600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:39.424865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] PATH_INFO: `/v3/users/11b35c0e8dd6466fa1111ef4f373d9cb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:39.426243 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=11b35c0e8dd6466fa1111ef4f373d9cb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:39.427303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:15:39.427303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:15:39.427303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:15:39.428430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:39.738965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11b35c0e8dd6466fa1111ef4f373d9cb'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:39.758099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11b35c0e8dd6466fa1111ef4f373d9cb'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:39.769780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11b35c0e8dd6466fa1111ef4f373d9cb'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:39.770607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11b35c0e8dd6466fa1111ef4f373d9cb'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:39.837516 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11b35c0e8dd6466fa1111ef4f373d9cb'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:39.844365 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 725/1448] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:15:39 2021] DELETE /identity/v3/users/11b35c0e8dd6466fa1111ef4f373d9cb => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:15:39.848866 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392578ba-70ad-40fd-b537-07a4e3849340 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:39.849333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392578ba-70ad-40fd-b537-07a4e3849340 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:39.849540 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392578ba-70ad-40fd-b537-07a4e3849340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:39.868192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-392578ba-70ad-40fd-b537-07a4e3849340 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:15:39.869635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-392578ba-70ad-40fd-b537-07a4e3849340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:39.924858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 724/1449] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:15:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:15:39.934581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:39.935955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:39.992866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46796c-7e13-49ab-9375-2691c1f722ec admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:39.996671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbdecf-2f1e-437e-abb8-397399ea8bea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:39.997319 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbdecf-2f1e-437e-abb8-397399ea8bea service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:39.997600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbdecf-2f1e-437e-abb8-397399ea8bea service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:39.997875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbdecf-2f1e-437e-abb8-397399ea8bea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:40.007572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbdecf-2f1e-437e-abb8-397399ea8bea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:40.009025 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbdecf-2f1e-437e-abb8-397399ea8bea service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:40.019178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 726/1450] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:15:39 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:15:40.428580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392578ba-70ad-40fd-b537-07a4e3849340 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:15:40.430060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-392578ba-70ad-40fd-b537-07a4e3849340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:15:40.443243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392578ba-70ad-40fd-b537-07a4e3849340 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:15:40.449071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:15:40.449959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:15:40.450259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:15:40.455211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] PATH_INFO: `/v3/projects/d5626034fc5147219eb2995c293cfe54` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:15:40.455211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5626034fc5147219eb2995c293cfe54)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:15:40.455211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:15:40.455211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:15:40.455211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:15:40.456584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:15:40.567857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5626034fc5147219eb2995c293cfe54', 'request_id': 'req-0f775565-aed1-420d-a42a-e6e7b6a31096'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:40.581043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5626034fc5147219eb2995c293cfe54', 'request_id': 'req-0f775565-aed1-420d-a42a-e6e7b6a31096'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:40.586746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5626034fc5147219eb2995c293cfe54', 'request_id': 'req-0f775565-aed1-420d-a42a-e6e7b6a31096'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:40.654490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] The token cache is being invalidate because project d5626034fc5147219eb2995c293cfe54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:15:40.655323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:40.656194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0f775565-aed1-420d-a42a-e6e7b6a31096 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:15:40.657785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 725/1451] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:15:40 2021] DELETE /identity/v3/projects/d5626034fc5147219eb2995c293cfe54 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:17:10.972873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd6e9a-0bc2-402b-985e-e25a1a545be7 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:10.973520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd6e9a-0bc2-402b-985e-e25a1a545be7 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:10.973520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cd6e9a-0bc2-402b-985e-e25a1a545be7 None None] PATH_INFO: `/v3` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:10.974758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 727/1452] 10.222.0.36 () {54 vars in 925 bytes} [Wed Oct 27 01:17:10 2021] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:17:10.982616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6421-3fb0-4531-9085-5a24befa7ac7 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:10.983048 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6421-3fb0-4531-9085-5a24befa7ac7 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:10.983213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbef6421-3fb0-4531-9085-5a24befa7ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:11.004455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-fbef6421-3fb0-4531-9085-5a24befa7ac7 None None] MFA Rules not processed for user `8df6e02fde834883aef230f31d6ecd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:11.005668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fbef6421-3fb0-4531-9085-5a24befa7ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:11.067213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 726/1453] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Oct 27 01:17:10 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:11.511852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c55eb-966e-4f7e-8ae7-578918240956 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:11.512135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c55eb-966e-4f7e-8ae7-578918240956 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:11.512411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3c55eb-966e-4f7e-8ae7-578918240956 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:11.514283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 728/1454] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 01:17:11 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:11.519758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe8f50-0c08-482d-891d-3a8717f3fb7d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:11.520047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe8f50-0c08-482d-891d-3a8717f3fb7d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:11.520320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbe8f50-0c08-482d-891d-3a8717f3fb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:11.542962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-2dbe8f50-0c08-482d-891d-3a8717f3fb7d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:11.544156 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2dbe8f50-0c08-482d-891d-3a8717f3fb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:11.599632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 727/1455] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 01:17:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:11.755367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c55eb-966e-4f7e-8ae7-578918240956 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:11.756915 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-da3c55eb-966e-4f7e-8ae7-578918240956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:11.828898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3c55eb-966e-4f7e-8ae7-578918240956 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:11.834212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc4ff6-01eb-421c-9261-da84b63972d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:11.834844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc4ff6-01eb-421c-9261-da84b63972d1 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:11.835118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc4ff6-01eb-421c-9261-da84b63972d1 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:11.835386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc4ff6-01eb-421c-9261-da84b63972d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:11.843263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc4ff6-01eb-421c-9261-da84b63972d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:11.844824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfc4ff6-01eb-421c-9261-da84b63972d1 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:11.853807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 729/1456] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:17:11 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:13.285335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f7e2-0c24-43d6-bbfe-b4dcc6c9bc62 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:13.285859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f7e2-0c24-43d6-bbfe-b4dcc6c9bc62 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:13.285859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870f7e2-0c24-43d6-bbfe-b4dcc6c9bc62 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:13.287637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 728/1457] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 01:17:13 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:13.292953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd36b22-f026-4847-aebd-2df9782eefad None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:13.293370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd36b22-f026-4847-aebd-2df9782eefad None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:13.293486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd36b22-f026-4847-aebd-2df9782eefad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:13.311033 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2cd36b22-f026-4847-aebd-2df9782eefad None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:13.312210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2cd36b22-f026-4847-aebd-2df9782eefad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:13.319736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 730/1458] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 01:17:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:13.472653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870f7e2-0c24-43d6-bbfe-b4dcc6c9bc62 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:13.487445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870f7e2-0c24-43d6-bbfe-b4dcc6c9bc62 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:13.492972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9430c-c927-4b4d-ae43-2bd8964e5804 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:13.493603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9430c-c927-4b4d-ae43-2bd8964e5804 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:13.493879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9430c-c927-4b4d-ae43-2bd8964e5804 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:13.494180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9430c-c927-4b4d-ae43-2bd8964e5804 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:13.502189 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9430c-c927-4b4d-ae43-2bd8964e5804 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:13.503780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9430c-c927-4b4d-ae43-2bd8964e5804 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:13.513002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 729/1459] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:17:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:20.160110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894efdc0-2de7-4fec-8b6f-c95b5a8f0331 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:20.160540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894efdc0-2de7-4fec-8b6f-c95b5a8f0331 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:20.160648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894efdc0-2de7-4fec-8b6f-c95b5a8f0331 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:20.162474 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 731/1460] 10.222.0.32 () {54 vars in 960 bytes} [Wed Oct 27 01:17:20 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:20.168308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448c9a-0ce9-4f64-a9aa-78d70b8cfac4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:20.168802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448c9a-0ce9-4f64-a9aa-78d70b8cfac4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:20.168904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9448c9a-0ce9-4f64-a9aa-78d70b8cfac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:20.186383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b9448c9a-0ce9-4f64-a9aa-78d70b8cfac4 None None] MFA Rules not processed for user `8df6e02fde834883aef230f31d6ecd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:20.188831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b9448c9a-0ce9-4f64-a9aa-78d70b8cfac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:20.195789 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 730/1461] 10.222.0.32 () {58 vars in 1057 bytes} [Wed Oct 27 01:17:20 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:20.203902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894efdc0-2de7-4fec-8b6f-c95b5a8f0331 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:20.217771 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894efdc0-2de7-4fec-8b6f-c95b5a8f0331 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:20.222788 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0f927-145f-4804-ad66-1008da65dd45 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8df6e02fde834883aef230f31d6ecd94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:20.223410 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0f927-145f-4804-ad66-1008da65dd45 service placement] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:20.223691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0f927-145f-4804-ad66-1008da65dd45 service placement] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:20.223960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0f927-145f-4804-ad66-1008da65dd45 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:20.233087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0f927-145f-4804-ad66-1008da65dd45 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:20.234718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0f927-145f-4804-ad66-1008da65dd45 service placement] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:20.244302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 732/1462] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:17:20 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:17:25.365246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b45e2-3aa6-4969-97c2-61299cfd4842 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:25.365783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b45e2-3aa6-4969-97c2-61299cfd4842 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:25.365783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b45e2-3aa6-4969-97c2-61299cfd4842 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:25.367561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 731/1463] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 01:17:25 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:25.373666 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c23a72-6ccf-4d10-ae8b-37277a0c9df3 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:25.374122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c23a72-6ccf-4d10-ae8b-37277a0c9df3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:25.374223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c23a72-6ccf-4d10-ae8b-37277a0c9df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:25.392525 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-93c23a72-6ccf-4d10-ae8b-37277a0c9df3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:25.393680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-93c23a72-6ccf-4d10-ae8b-37277a0c9df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:25.401423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 733/1464] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 01:17:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:25.557235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b45e2-3aa6-4969-97c2-61299cfd4842 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:25.571158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b45e2-3aa6-4969-97c2-61299cfd4842 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:25.576507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878bbce-8714-4403-8003-fbdef0dbe2b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:25.577125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bbce-8714-4403-8003-fbdef0dbe2b2 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:25.577400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bbce-8714-4403-8003-fbdef0dbe2b2 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:25.577675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878bbce-8714-4403-8003-fbdef0dbe2b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:25.585375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878bbce-8714-4403-8003-fbdef0dbe2b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:25.586961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d878bbce-8714-4403-8003-fbdef0dbe2b2 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:25.596471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 732/1465] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:17:25 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:27.020370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1246-63a0-4b7e-9ca0-4096eed51f07 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:27.020807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1246-63a0-4b7e-9ca0-4096eed51f07 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:27.020914 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb1246-63a0-4b7e-9ca0-4096eed51f07 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:27.022721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 734/1466] 127.0.0.1 () {54 vars in 901 bytes} [Wed Oct 27 01:17:27 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:27.028600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb11ee-3dd7-4448-b5c6-96d43a521ff9 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:27.029052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb11ee-3dd7-4448-b5c6-96d43a521ff9 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:27.029158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb11ee-3dd7-4448-b5c6-96d43a521ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:27.047484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e1eb11ee-3dd7-4448-b5c6-96d43a521ff9 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:27.048651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e1eb11ee-3dd7-4448-b5c6-96d43a521ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:27.056356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 733/1467] 127.0.0.1 () {58 vars in 998 bytes} [Wed Oct 27 01:17:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:27.212414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1246-63a0-4b7e-9ca0-4096eed51f07 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:27.227626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb1246-63a0-4b7e-9ca0-4096eed51f07 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:27.233136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18278e48-96c1-4acd-bf94-e61c549dbf76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:27.235136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278e48-96c1-4acd-bf94-e61c549dbf76 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:27.235136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278e48-96c1-4acd-bf94-e61c549dbf76 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:27.235136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18278e48-96c1-4acd-bf94-e61c549dbf76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:27.242643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18278e48-96c1-4acd-bf94-e61c549dbf76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:27.244191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18278e48-96c1-4acd-bf94-e61c549dbf76 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:27.254570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 735/1468] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:17:27 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:31.457655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00888-f60e-4b71-a5ef-9dc52a6fe174 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:31.458062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00888-f60e-4b71-a5ef-9dc52a6fe174 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:31.458062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff00888-f60e-4b71-a5ef-9dc52a6fe174 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:31.459785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 734/1469] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 01:17:31 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:31.465762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c89b8-aa69-4a81-adfe-77aa4fdeee12 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:31.466211 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c89b8-aa69-4a81-adfe-77aa4fdeee12 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:31.466342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000c89b8-aa69-4a81-adfe-77aa4fdeee12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:31.484495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-000c89b8-aa69-4a81-adfe-77aa4fdeee12 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:31.485662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-000c89b8-aa69-4a81-adfe-77aa4fdeee12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:31.493624 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 736/1470] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 01:17:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:31.534976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff00888-f60e-4b71-a5ef-9dc52a6fe174 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:31.536659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5ff00888-f60e-4b71-a5ef-9dc52a6fe174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:31.591636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff00888-f60e-4b71-a5ef-9dc52a6fe174 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:31.595166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12688c68-1b44-4d02-ba32-c2f69d1fa10d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:31.595855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688c68-1b44-4d02-ba32-c2f69d1fa10d service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:31.596155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688c68-1b44-4d02-ba32-c2f69d1fa10d service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:31.596424 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12688c68-1b44-4d02-ba32-c2f69d1fa10d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:31.605844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688c68-1b44-4d02-ba32-c2f69d1fa10d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:31.607295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12688c68-1b44-4d02-ba32-c2f69d1fa10d service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:31.616453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 735/1471] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:17:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:33.853124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35098-1b22-4754-b6be-572e82e68cdb None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:33.853654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35098-1b22-4754-b6be-572e82e68cdb None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:33.853654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b35098-1b22-4754-b6be-572e82e68cdb None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:33.856132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 737/1472] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 01:17:33 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:33.861956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a662f-5337-4081-b42c-ee2939c484f4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:33.862392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a662f-5337-4081-b42c-ee2939c484f4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:33.862547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91a662f-5337-4081-b42c-ee2939c484f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:33.882726 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b91a662f-5337-4081-b42c-ee2939c484f4 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:33.883912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b91a662f-5337-4081-b42c-ee2939c484f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:33.891643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 736/1473] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 01:17:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:33.929068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b35098-1b22-4754-b6be-572e82e68cdb None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:33.940298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b35098-1b22-4754-b6be-572e82e68cdb None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:33.943945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac408e6-b7b0-4afd-9037-91bc2a1f6d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:33.944566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac408e6-b7b0-4afd-9037-91bc2a1f6d9c service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:33.944843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac408e6-b7b0-4afd-9037-91bc2a1f6d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:33.945111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac408e6-b7b0-4afd-9037-91bc2a1f6d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:33.954070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac408e6-b7b0-4afd-9037-91bc2a1f6d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:33.955478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac408e6-b7b0-4afd-9037-91bc2a1f6d9c service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:33.964708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 738/1474] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:17:33 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:37.796222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f25f4-27cf-453b-81b6-35e6d31dd72c None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:37.796769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f25f4-27cf-453b-81b6-35e6d31dd72c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:37.796769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f25f4-27cf-453b-81b6-35e6d31dd72c None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:37.798567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 737/1475] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 01:17:37 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:37.804223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40eecc-be25-45b5-a1e9-98718379f8ac None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:37.804673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40eecc-be25-45b5-a1e9-98718379f8ac None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:37.804778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40eecc-be25-45b5-a1e9-98718379f8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:37.822944 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-bb40eecc-be25-45b5-a1e9-98718379f8ac None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:37.824121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-bb40eecc-be25-45b5-a1e9-98718379f8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:37.831691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 739/1476] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 01:17:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:37.883008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f25f4-27cf-453b-81b6-35e6d31dd72c None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:37.884657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-cd7f25f4-27cf-453b-81b6-35e6d31dd72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:37.940533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f25f4-27cf-453b-81b6-35e6d31dd72c None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:37.944076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb1d3e-dc28-45ac-ad90-7bb67e4fbb50 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:37.944725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb1d3e-dc28-45ac-ad90-7bb67e4fbb50 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:37.945003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb1d3e-dc28-45ac-ad90-7bb67e4fbb50 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:37.945275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb1d3e-dc28-45ac-ad90-7bb67e4fbb50 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:37.954754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb1d3e-dc28-45ac-ad90-7bb67e4fbb50 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:37.956167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb1d3e-dc28-45ac-ad90-7bb67e4fbb50 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:37.966173 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 738/1477] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:17:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:17:40.303456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db2a2e-be8a-412b-b8b3-91f60abfb39f None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:40.304008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db2a2e-be8a-412b-b8b3-91f60abfb39f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:40.304008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db2a2e-be8a-412b-b8b3-91f60abfb39f None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:40.305681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 740/1478] 127.0.0.1 () {54 vars in 916 bytes} [Wed Oct 27 01:17:40 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:40.311660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479e1f7-2be1-4d88-9e62-a988fe72feb6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:40.312107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479e1f7-2be1-4d88-9e62-a988fe72feb6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:40.312216 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5479e1f7-2be1-4d88-9e62-a988fe72feb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:40.329895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5479e1f7-2be1-4d88-9e62-a988fe72feb6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:40.331114 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5479e1f7-2be1-4d88-9e62-a988fe72feb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:40.339443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 739/1479] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Oct 27 01:17:40 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:40.390165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694b98b-348e-4513-8ea6-3a0ac67ff549 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:40.390448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694b98b-348e-4513-8ea6-3a0ac67ff549 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:40.390724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4694b98b-348e-4513-8ea6-3a0ac67ff549 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:40.392480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 741/1480] 10.222.0.32 () {54 vars in 962 bytes} [Wed Oct 27 01:17:40 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:17:40.397552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ad204-3ccc-484e-a790-f8e138767c71 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:40.397842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ad204-3ccc-484e-a790-f8e138767c71 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:40.398154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4ad204-3ccc-484e-a790-f8e138767c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:40.417071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-2b4ad204-3ccc-484e-a790-f8e138767c71 None None] MFA Rules not processed for user `6d490db0d91a4426930130a4f83f7bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:17:40.418266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2b4ad204-3ccc-484e-a790-f8e138767c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:17:40.424556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 740/1481] 10.222.0.32 () {58 vars in 1059 bytes} [Wed Oct 27 01:17:40 2021] POST /identity/v3/auth/tokens => generated 3263 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:17:40.432424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694b98b-348e-4513-8ea6-3a0ac67ff549 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:17:40.442514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4694b98b-348e-4513-8ea6-3a0ac67ff549 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:17:40.445905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a2eceb-388f-4dd7-8481-e6cc88b142b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:17:40.446547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2eceb-388f-4dd7-8481-e6cc88b142b0 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:17:40.446823 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2eceb-388f-4dd7-8481-e6cc88b142b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:17:40.447090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a2eceb-388f-4dd7-8481-e6cc88b142b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:17:40.455721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2eceb-388f-4dd7-8481-e6cc88b142b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:17:40.457113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a2eceb-388f-4dd7-8481-e6cc88b142b0 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:17:40.467022 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 742/1482] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:17:40 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:02.819948 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0225c89-cc52-46a6-b71f-48cacbacbdaf None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:02.820549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0225c89-cc52-46a6-b71f-48cacbacbdaf None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:02.820549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0225c89-cc52-46a6-b71f-48cacbacbdaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:02.838242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed79d0-6589-4f5a-8d45-9fad1c14b178 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:02.838764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed79d0-6589-4f5a-8d45-9fad1c14b178 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:02.838764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ed79d0-6589-4f5a-8d45-9fad1c14b178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:02.855353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c0225c89-cc52-46a6-b71f-48cacbacbdaf None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:02.856578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c0225c89-cc52-46a6-b71f-48cacbacbdaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:02.866085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-56ed79d0-6589-4f5a-8d45-9fad1c14b178 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:02.867286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-56ed79d0-6589-4f5a-8d45-9fad1c14b178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:02.867742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 741/1483] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:02.877284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223a409-c416-478d-8d9a-a97016384db7 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:02.879070 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223a409-c416-478d-8d9a-a97016384db7 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:02.879529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223a409-c416-478d-8d9a-a97016384db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:02.892111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 743/1484] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:02.930153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9223a409-c416-478d-8d9a-a97016384db7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:02.930536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced479e7-8f3e-4fa2-836a-86fe1b74aeba None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:02.931153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9223a409-c416-478d-8d9a-a97016384db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:02.931258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced479e7-8f3e-4fa2-836a-86fe1b74aeba None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:02.931258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced479e7-8f3e-4fa2-836a-86fe1b74aeba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:02.952079 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 742/1485] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:02.962087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223a409-c416-478d-8d9a-a97016384db7 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:02.973553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ced479e7-8f3e-4fa2-836a-86fe1b74aeba None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:02.975119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ced479e7-8f3e-4fa2-836a-86fe1b74aeba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:02.976673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223a409-c416-478d-8d9a-a97016384db7 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:02.994551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 744/1486] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:02.996127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d581a-0c4a-4da3-92a6-6dc729f4d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:02.996572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fd4c6-a08a-414a-b61f-fc77ad30c18d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:02.996800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d581a-0c4a-4da3-92a6-6dc729f4d606 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:02.997098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d581a-0c4a-4da3-92a6-6dc729f4d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:02.997369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d581a-0c4a-4da3-92a6-6dc729f4d606 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:02.997933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fd4c6-a08a-414a-b61f-fc77ad30c18d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:02.998156 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d581a-0c4a-4da3-92a6-6dc729f4d606 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:02.998450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d581a-0c4a-4da3-92a6-6dc729f4d606 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:02.998866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441fd4c6-a08a-414a-b61f-fc77ad30c18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.007758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d581a-0c4a-4da3-92a6-6dc729f4d606 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.045561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-441fd4c6-a08a-414a-b61f-fc77ad30c18d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.047821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-441fd4c6-a08a-414a-b61f-fc77ad30c18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.048748 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 743/1487] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:03.050443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a4b1-3ed0-4765-b133-cbdb00f3e9c2 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.051838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a4b1-3ed0-4765-b133-cbdb00f3e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.052349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d823a4b1-3ed0-4765-b133-cbdb00f3e9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.070308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 745/1488] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:02 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.072117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fd4c6-a08a-414a-b61f-fc77ad30c18d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.077475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d823a4b1-3ed0-4765-b133-cbdb00f3e9c2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.080225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d823a4b1-3ed0-4765-b133-cbdb00f3e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.086252 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441fd4c6-a08a-414a-b61f-fc77ad30c18d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.088381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 744/1489] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.089694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e74889-bb45-4c97-84ce-bb4e767f2ae0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.090119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e74889-bb45-4c97-84ce-bb4e767f2ae0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.091676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e74889-bb45-4c97-84ce-bb4e767f2ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.097361 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d49ca-d35e-4281-9883-f3814f31a147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.098472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d49ca-d35e-4281-9883-f3814f31a147 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.099027 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d49ca-d35e-4281-9883-f3814f31a147 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.099508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d49ca-d35e-4281-9883-f3814f31a147 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.100480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d49ca-d35e-4281-9883-f3814f31a147 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:03.100983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d49ca-d35e-4281-9883-f3814f31a147 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.104118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2d49ca-d35e-4281-9883-f3814f31a147 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.116359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-39e74889-bb45-4c97-84ce-bb4e767f2ae0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.117062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 746/1490] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:03.118390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d49ca-d35e-4281-9883-f3814f31a147 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.118947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-39e74889-bb45-4c97-84ce-bb4e767f2ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.128803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 745/1491] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.128977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d49ca-d35e-4281-9883-f3814f31a147 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.130525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3a29c-b5c7-4942-b993-9b4e4d836a9b None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.131023 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3a29c-b5c7-4942-b993-9b4e4d836a9b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.131512 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3a29c-b5c7-4942-b993-9b4e4d836a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.134594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adff4c4-877f-45ae-9980-bc576f99b50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.135576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff4c4-877f-45ae-9980-bc576f99b50b admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.135864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff4c4-877f-45ae-9980-bc576f99b50b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.136141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adff4c4-877f-45ae-9980-bc576f99b50b admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.136954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adff4c4-877f-45ae-9980-bc576f99b50b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.139024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adff4c4-877f-45ae-9980-bc576f99b50b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.160928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-95b3a29c-b5c7-4942-b993-9b4e4d836a9b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.162168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-95b3a29c-b5c7-4942-b993-9b4e4d836a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.170235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 746/1492] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.173214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e08196-142b-4e91-bfdd-f04efbcb73df None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.173511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e08196-142b-4e91-bfdd-f04efbcb73df None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.173801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e08196-142b-4e91-bfdd-f04efbcb73df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.192332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-41e08196-142b-4e91-bfdd-f04efbcb73df None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.193520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-41e08196-142b-4e91-bfdd-f04efbcb73df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.201965 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 747/1493] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.203958 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d144c86-2ebc-4bd8-b0e3-902c294ad9c5 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.204244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d144c86-2ebc-4bd8-b0e3-902c294ad9c5 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.204518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d144c86-2ebc-4bd8-b0e3-902c294ad9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.222584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-3d144c86-2ebc-4bd8-b0e3-902c294ad9c5 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.223730 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3d144c86-2ebc-4bd8-b0e3-902c294ad9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.231525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 748/1494] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.232859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9e0c6-a900-440a-bc31-fab69fe23f92 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.233146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9e0c6-a900-440a-bc31-fab69fe23f92 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.233416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d9e0c6-a900-440a-bc31-fab69fe23f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.251149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-06d9e0c6-a900-440a-bc31-fab69fe23f92 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.252286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-06d9e0c6-a900-440a-bc31-fab69fe23f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.260676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 749/1495] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.261414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9e0c6-a900-440a-bc31-fab69fe23f92 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.262969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 747/1496] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:03.264481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c55d9-10d6-422b-8ab9-ad4f8476ffcd None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.265042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c55d9-10d6-422b-8ab9-ad4f8476ffcd None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.265494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2c55d9-10d6-422b-8ab9-ad4f8476ffcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.273064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d9e0c6-a900-440a-bc31-fab69fe23f92 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.283361 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ae2c55d9-10d6-422b-8ab9-ad4f8476ffcd None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.284672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ae2c55d9-10d6-422b-8ab9-ad4f8476ffcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.326802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a3a29-43e9-43f8-b367-afa34775b85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.327463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a3a29-43e9-43f8-b367-afa34775b85f admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.327843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a3a29-43e9-43f8-b367-afa34775b85f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.328117 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4a3a29-43e9-43f8-b367-afa34775b85f admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.328894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a3a29-43e9-43f8-b367-afa34775b85f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.330932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4a3a29-43e9-43f8-b367-afa34775b85f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.343209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 748/1497] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.344510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1838d-b8ba-4d6b-b298-a27bd7cb3c51 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.344796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1838d-b8ba-4d6b-b298-a27bd7cb3c51 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.345068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1838d-b8ba-4d6b-b298-a27bd7cb3c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.362792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-cee1838d-b8ba-4d6b-b298-a27bd7cb3c51 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.363972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-cee1838d-b8ba-4d6b-b298-a27bd7cb3c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.372225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 749/1498] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.374393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486b70b-7efb-4e5c-b16c-69ba1580062f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.374677 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486b70b-7efb-4e5c-b16c-69ba1580062f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.374954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486b70b-7efb-4e5c-b16c-69ba1580062f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.394364 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0486b70b-7efb-4e5c-b16c-69ba1580062f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.398250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0486b70b-7efb-4e5c-b16c-69ba1580062f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.403738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 750/1499] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.404493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486b70b-7efb-4e5c-b16c-69ba1580062f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.413148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486b70b-7efb-4e5c-b16c-69ba1580062f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.418481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d126a-5c19-4c2c-80c6-08d3278e09ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.419093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d126a-5c19-4c2c-80c6-08d3278e09ac admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.419369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d126a-5c19-4c2c-80c6-08d3278e09ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.419642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3d126a-5c19-4c2c-80c6-08d3278e09ac admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.420388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d126a-5c19-4c2c-80c6-08d3278e09ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:03.420688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d126a-5c19-4c2c-80c6-08d3278e09ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.422318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3d126a-5c19-4c2c-80c6-08d3278e09ac admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.429117 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 750/1500] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:03.432693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a3a29-43e9-43f8-b367-afa34775b85f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.434630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 751/1501] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:03.435927 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d126a-5c19-4c2c-80c6-08d3278e09ac admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.445251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3d126a-5c19-4c2c-80c6-08d3278e09ac admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.498968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8d407-4ec1-4f06-a343-48545a5241af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.499635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8d407-4ec1-4f06-a343-48545a5241af admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.499922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8d407-4ec1-4f06-a343-48545a5241af admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.500215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8d407-4ec1-4f06-a343-48545a5241af admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.500826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4a3a29-43e9-43f8-b367-afa34775b85f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.500959 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8d407-4ec1-4f06-a343-48545a5241af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.502829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8d407-4ec1-4f06-a343-48545a5241af admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.505722 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca5fb7-3b53-4b1a-8b4a-5c8ffd001e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.506498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5fb7-3b53-4b1a-8b4a-5c8ffd001e99 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.507106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5fb7-3b53-4b1a-8b4a-5c8ffd001e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.507385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5fb7-3b53-4b1a-8b4a-5c8ffd001e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.508119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca5fb7-3b53-4b1a-8b4a-5c8ffd001e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:03.508467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca5fb7-3b53-4b1a-8b4a-5c8ffd001e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.510081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca5fb7-3b53-4b1a-8b4a-5c8ffd001e99 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.521851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 751/1502] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:03.523193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2df949-95fc-4f88-b61e-d5a23c085f3b None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.523476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2df949-95fc-4f88-b61e-d5a23c085f3b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.526204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2df949-95fc-4f88-b61e-d5a23c085f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.542183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-dd2df949-95fc-4f88-b61e-d5a23c085f3b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.543400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-dd2df949-95fc-4f88-b61e-d5a23c085f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.551334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 752/1503] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.555008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2df949-95fc-4f88-b61e-d5a23c085f3b None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.561515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2df949-95fc-4f88-b61e-d5a23c085f3b None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.566151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654391cf-b6cc-40ae-9046-7040047670a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.566770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654391cf-b6cc-40ae-9046-7040047670a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.567049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654391cf-b6cc-40ae-9046-7040047670a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.567322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654391cf-b6cc-40ae-9046-7040047670a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.568034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654391cf-b6cc-40ae-9046-7040047670a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:03.568335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654391cf-b6cc-40ae-9046-7040047670a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.569997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654391cf-b6cc-40ae-9046-7040047670a1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.581255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 753/1504] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:03.582505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122271f-903f-4848-8697-75c55d5d6847 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.582788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122271f-903f-4848-8697-75c55d5d6847 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.583059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9122271f-903f-4848-8697-75c55d5d6847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.600573 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9122271f-903f-4848-8697-75c55d5d6847 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:03.601685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9122271f-903f-4848-8697-75c55d5d6847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:03.610319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 754/1505] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:03.611322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122271f-903f-4848-8697-75c55d5d6847 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.620868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9122271f-903f-4848-8697-75c55d5d6847 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.625374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0efbc8-c8ef-473a-833f-90e789c7888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.625991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0efbc8-c8ef-473a-833f-90e789c7888a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.626297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0efbc8-c8ef-473a-833f-90e789c7888a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.626567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0efbc8-c8ef-473a-833f-90e789c7888a admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.627281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0efbc8-c8ef-473a-833f-90e789c7888a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:03.627583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0efbc8-c8ef-473a-833f-90e789c7888a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.629140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0efbc8-c8ef-473a-833f-90e789c7888a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.640054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 752/1506] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/users => generated 286 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:03.640054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8d407-4ec1-4f06-a343-48545a5241af admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.643979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 755/1507] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:03.643979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0efbc8-c8ef-473a-833f-90e789c7888a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.650634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0efbc8-c8ef-473a-833f-90e789c7888a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.653344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8d407-4ec1-4f06-a343-48545a5241af admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.655395 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cda0b-0ff4-473e-9c12-b39765e63b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.656037 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cda0b-0ff4-473e-9c12-b39765e63b2f admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.656318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cda0b-0ff4-473e-9c12-b39765e63b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.656589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cda0b-0ff4-473e-9c12-b39765e63b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.657281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cda0b-0ff4-473e-9c12-b39765e63b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.657921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668109db-b6b7-4928-b5ae-728a134c3f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.658600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668109db-b6b7-4928-b5ae-728a134c3f54 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.658877 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668109db-b6b7-4928-b5ae-728a134c3f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.659148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668109db-b6b7-4928-b5ae-728a134c3f54 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.659325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cda0b-0ff4-473e-9c12-b39765e63b2f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.659834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668109db-b6b7-4928-b5ae-728a134c3f54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.661692 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668109db-b6b7-4928-b5ae-728a134c3f54 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.787532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 753/1508] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/users => generated 287 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:03.788362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668109db-b6b7-4928-b5ae-728a134c3f54 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.798582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668109db-b6b7-4928-b5ae-728a134c3f54 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.799964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 756/1509] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/projects => generated 393 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:03.800946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cda0b-0ff4-473e-9c12-b39765e63b2f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.857679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed874f-c87b-4f1d-aefc-63a2dc2e7e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.858264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed874f-c87b-4f1d-aefc-63a2dc2e7e70 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.858545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed874f-c87b-4f1d-aefc-63a2dc2e7e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.858812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed874f-c87b-4f1d-aefc-63a2dc2e7e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.859500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed874f-c87b-4f1d-aefc-63a2dc2e7e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.861758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed874f-c87b-4f1d-aefc-63a2dc2e7e70 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.861963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cda0b-0ff4-473e-9c12-b39765e63b2f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.866687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6c3b6-6fa1-4d67-8627-7569977f1804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.867339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6c3b6-6fa1-4d67-8627-7569977f1804 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.867614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6c3b6-6fa1-4d67-8627-7569977f1804 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.868544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a6c3b6-6fa1-4d67-8627-7569977f1804 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.869277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6c3b6-6fa1-4d67-8627-7569977f1804 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:03.869576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6c3b6-6fa1-4d67-8627-7569977f1804 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.871243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a6c3b6-6fa1-4d67-8627-7569977f1804 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:03.882414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 757/1510] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:03.885585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6c3b6-6fa1-4d67-8627-7569977f1804 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:03.892658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a6c3b6-6fa1-4d67-8627-7569977f1804 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:03.897167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72889-77bf-4726-b8df-3c81e2209416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:03.897785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72889-77bf-4726-b8df-3c81e2209416 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:03.898096 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72889-77bf-4726-b8df-3c81e2209416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:03.898368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf72889-77bf-4726-b8df-3c81e2209416 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:03.899046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf72889-77bf-4726-b8df-3c81e2209416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:03.901070 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf72889-77bf-4726-b8df-3c81e2209416 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.108304 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 758/1511] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/projects => generated 385 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.109054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72889-77bf-4726-b8df-3c81e2209416 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.137641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 754/1512] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:03 2021] POST /identity/v3/projects => generated 375 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.138523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed874f-c87b-4f1d-aefc-63a2dc2e7e70 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.178318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf72889-77bf-4726-b8df-3c81e2209416 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.207678 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed874f-c87b-4f1d-aefc-63a2dc2e7e70 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.212813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebdd19-e65e-4768-ae41-fae361e3e8d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.213462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebdd19-e65e-4768-ae41-fae361e3e8d0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.213741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebdd19-e65e-4768-ae41-fae361e3e8d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.214011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ebdd19-e65e-4768-ae41-fae361e3e8d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.214785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebdd19-e65e-4768-ae41-fae361e3e8d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.216364 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ebdd19-e65e-4768-ae41-fae361e3e8d0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.225950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 755/1513] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:04.226817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebdd19-e65e-4768-ae41-fae361e3e8d0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.233223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f42c9-1bfc-42b2-b1c5-7d802d6a853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.233886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f42c9-1bfc-42b2-b1c5-7d802d6a853b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.234190 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f42c9-1bfc-42b2-b1c5-7d802d6a853b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.234464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82f42c9-1bfc-42b2-b1c5-7d802d6a853b admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.235193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f42c9-1bfc-42b2-b1c5-7d802d6a853b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:04.235498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f42c9-1bfc-42b2-b1c5-7d802d6a853b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.237194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ebdd19-e65e-4768-ae41-fae361e3e8d0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.237331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82f42c9-1bfc-42b2-b1c5-7d802d6a853b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.241748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914bf14-a6a4-4456-80a5-0a5db2ec4a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.242406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914bf14-a6a4-4456-80a5-0a5db2ec4a1f admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.242689 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914bf14-a6a4-4456-80a5-0a5db2ec4a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.243009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914bf14-a6a4-4456-80a5-0a5db2ec4a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.243710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914bf14-a6a4-4456-80a5-0a5db2ec4a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.245547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914bf14-a6a4-4456-80a5-0a5db2ec4a1f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.248750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 759/1514] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:04.249542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f42c9-1bfc-42b2-b1c5-7d802d6a853b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.258509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82f42c9-1bfc-42b2-b1c5-7d802d6a853b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.263178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b0608-314b-45a5-870d-5953c67bfced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.263811 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b0608-314b-45a5-870d-5953c67bfced admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.264088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b0608-314b-45a5-870d-5953c67bfced admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.264359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22b0608-314b-45a5-870d-5953c67bfced admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.265076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b0608-314b-45a5-870d-5953c67bfced admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.266709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22b0608-314b-45a5-870d-5953c67bfced admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.276966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 760/1515] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:04.278162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b0608-314b-45a5-870d-5953c67bfced admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.287045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22b0608-314b-45a5-870d-5953c67bfced admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.292138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f390d63-4717-4416-a69e-a28968b5fe6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.292754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f390d63-4717-4416-a69e-a28968b5fe6c admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.293031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f390d63-4717-4416-a69e-a28968b5fe6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.293298 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f390d63-4717-4416-a69e-a28968b5fe6c admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.294074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f390d63-4717-4416-a69e-a28968b5fe6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.295933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f390d63-4717-4416-a69e-a28968b5fe6c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.337643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 756/1516] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:04 2021] POST /identity/v3/projects => generated 377 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.338591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914bf14-a6a4-4456-80a5-0a5db2ec4a1f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.397414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914bf14-a6a4-4456-80a5-0a5db2ec4a1f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.402909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94ad9-df3a-427b-b673-9685ecffabe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.403561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94ad9-df3a-427b-b673-9685ecffabe3 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.403860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94ad9-df3a-427b-b673-9685ecffabe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.404114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d94ad9-df3a-427b-b673-9685ecffabe3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.404813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d94ad9-df3a-427b-b673-9685ecffabe3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.406732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d94ad9-df3a-427b-b673-9685ecffabe3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.417386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 761/1517] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:04 2021] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.421602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f390d63-4717-4416-a69e-a28968b5fe6c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.428081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f390d63-4717-4416-a69e-a28968b5fe6c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.432942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cbf28-6189-4b02-9ab5-1fc7a60db332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.433579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbf28-6189-4b02-9ab5-1fc7a60db332 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.433881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbf28-6189-4b02-9ab5-1fc7a60db332 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.434192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cbf28-6189-4b02-9ab5-1fc7a60db332 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.434878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cbf28-6189-4b02-9ab5-1fc7a60db332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.436747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59cbf28-6189-4b02-9ab5-1fc7a60db332 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.503694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 757/1518] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:04 2021] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.504680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94ad9-df3a-427b-b673-9685ecffabe3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.530540 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 762/1519] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:04 2021] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.531573 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cbf28-6189-4b02-9ab5-1fc7a60db332 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.541506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cbf28-6189-4b02-9ab5-1fc7a60db332 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.565128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d94ad9-df3a-427b-b673-9685ecffabe3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.569639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28760fa6-d049-4206-bd56-1b09eae1d571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.570322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28760fa6-d049-4206-bd56-1b09eae1d571 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.570598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28760fa6-d049-4206-bd56-1b09eae1d571 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.571390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28760fa6-d049-4206-bd56-1b09eae1d571 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.572284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28760fa6-d049-4206-bd56-1b09eae1d571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.574200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28760fa6-d049-4206-bd56-1b09eae1d571 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.594661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b5032-5cbc-45e5-8a56-75b7802d3371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.595328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b5032-5cbc-45e5-8a56-75b7802d3371 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.595601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b5032-5cbc-45e5-8a56-75b7802d3371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.595878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b5032-5cbc-45e5-8a56-75b7802d3371 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.596597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b5032-5cbc-45e5-8a56-75b7802d3371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.598253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b5032-5cbc-45e5-8a56-75b7802d3371 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.607969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 763/1520] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:04.608730 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b5032-5cbc-45e5-8a56-75b7802d3371 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.618337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b5032-5cbc-45e5-8a56-75b7802d3371 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.622875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad59a7-637d-4cd8-a764-ecb62fa5ca28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.623477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad59a7-637d-4cd8-a764-ecb62fa5ca28 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.623750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad59a7-637d-4cd8-a764-ecb62fa5ca28 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.626558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad59a7-637d-4cd8-a764-ecb62fa5ca28 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.626558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad59a7-637d-4cd8-a764-ecb62fa5ca28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.626558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad59a7-637d-4cd8-a764-ecb62fa5ca28 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.650787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 758/1521] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:04 2021] POST /identity/v3/users => generated 288 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.651770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28760fa6-d049-4206-bd56-1b09eae1d571 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.660857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28760fa6-d049-4206-bd56-1b09eae1d571 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.665711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88040a7-8f6f-46a7-8ad9-7ffd6de65915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.666424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88040a7-8f6f-46a7-8ad9-7ffd6de65915 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.666699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88040a7-8f6f-46a7-8ad9-7ffd6de65915 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.666997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88040a7-8f6f-46a7-8ad9-7ffd6de65915 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.667714 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88040a7-8f6f-46a7-8ad9-7ffd6de65915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.669300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88040a7-8f6f-46a7-8ad9-7ffd6de65915 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.678821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 759/1522] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:04.679558 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88040a7-8f6f-46a7-8ad9-7ffd6de65915 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.688809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88040a7-8f6f-46a7-8ad9-7ffd6de65915 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.693206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e831e3e-ef27-4084-8cab-22951ff330ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.693791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e831e3e-ef27-4084-8cab-22951ff330ce admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.694172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e831e3e-ef27-4084-8cab-22951ff330ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.694498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e831e3e-ef27-4084-8cab-22951ff330ce admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.695215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e831e3e-ef27-4084-8cab-22951ff330ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.697673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e831e3e-ef27-4084-8cab-22951ff330ce admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.703821 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 764/1523] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:04 2021] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.704817 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad59a7-637d-4cd8-a764-ecb62fa5ca28 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.763299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 760/1524] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:04 2021] POST /identity/v3/users => generated 289 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.763299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e831e3e-ef27-4084-8cab-22951ff330ce admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.764278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad59a7-637d-4cd8-a764-ecb62fa5ca28 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.769016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995f06-c109-40e4-a54f-3cdfa3c63680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.769677 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995f06-c109-40e4-a54f-3cdfa3c63680 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.769956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995f06-c109-40e4-a54f-3cdfa3c63680 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.770256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2995f06-c109-40e4-a54f-3cdfa3c63680 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.770450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e831e3e-ef27-4084-8cab-22951ff330ce admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.770985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2995f06-c109-40e4-a54f-3cdfa3c63680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.772637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2995f06-c109-40e4-a54f-3cdfa3c63680 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.776139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112d731-d4f8-4d86-bdca-6265e950e840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.776794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112d731-d4f8-4d86-bdca-6265e950e840 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.777077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112d731-d4f8-4d86-bdca-6265e950e840 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.777359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7112d731-d4f8-4d86-bdca-6265e950e840 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.778082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112d731-d4f8-4d86-bdca-6265e950e840 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.779986 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7112d731-d4f8-4d86-bdca-6265e950e840 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.783228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 765/1525] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:04.784306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995f06-c109-40e4-a54f-3cdfa3c63680 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.793658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2995f06-c109-40e4-a54f-3cdfa3c63680 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.798297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781194-5281-4722-b246-ab294b1715bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.798938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781194-5281-4722-b246-ab294b1715bc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.799218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781194-5281-4722-b246-ab294b1715bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.799490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36781194-5281-4722-b246-ab294b1715bc admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.800205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781194-5281-4722-b246-ab294b1715bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.801804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36781194-5281-4722-b246-ab294b1715bc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.814665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 766/1526] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:04.815448 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781194-5281-4722-b246-ab294b1715bc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.830045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36781194-5281-4722-b246-ab294b1715bc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.834741 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d45fb-fadb-43ec-bcd6-1fb502df5370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.835599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d45fb-fadb-43ec-bcd6-1fb502df5370 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.835936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d45fb-fadb-43ec-bcd6-1fb502df5370 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.836217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2d45fb-fadb-43ec-bcd6-1fb502df5370 admin admin] PATH_INFO: `/v3/projects/d18990ef0fb945dba805b8bdee85a240/users/bc03fcc11ac3464aa1bd60833a23a3e3/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.852570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d45fb-fadb-43ec-bcd6-1fb502df5370 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18990ef0fb945dba805b8bdee85a240, user_id=bc03fcc11ac3464aa1bd60833a23a3e3, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.855554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2d45fb-fadb-43ec-bcd6-1fb502df5370 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.867392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 761/1527] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:04 2021] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:04.870403 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112d731-d4f8-4d86-bdca-6265e950e840 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.877950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7112d731-d4f8-4d86-bdca-6265e950e840 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.882710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188d97-fdd9-4d10-831c-bc6e7b0bc0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.883343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188d97-fdd9-4d10-831c-bc6e7b0bc0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.884218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188d97-fdd9-4d10-831c-bc6e7b0bc0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.884720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7188d97-fdd9-4d10-831c-bc6e7b0bc0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.885642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7188d97-fdd9-4d10-831c-bc6e7b0bc0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.887336 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7188d97-fdd9-4d10-831c-bc6e7b0bc0a1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.897051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 762/1528] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:04 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:04.899792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188d97-fdd9-4d10-831c-bc6e7b0bc0a1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.907779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7188d97-fdd9-4d10-831c-bc6e7b0bc0a1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.912407 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fe1ee-5b2d-45b2-921a-a50d8dfcc9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.913228 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fe1ee-5b2d-45b2-921a-a50d8dfcc9d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.913511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fe1ee-5b2d-45b2-921a-a50d8dfcc9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.913784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05fe1ee-5b2d-45b2-921a-a50d8dfcc9d8 admin admin] PATH_INFO: `/v3/projects/8a1a4405ba004d2b9af81d28eb68feb0/users/020d52200aa747ce8dff02936da56303/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.934580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 767/1529] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:04 2021] PUT /identity/v3/projects/d18990ef0fb945dba805b8bdee85a240/users/bc03fcc11ac3464aa1bd60833a23a3e3/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:04.934580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d45fb-fadb-43ec-bcd6-1fb502df5370 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:04.938882 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fe1ee-5b2d-45b2-921a-a50d8dfcc9d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a1a4405ba004d2b9af81d28eb68feb0, user_id=020d52200aa747ce8dff02936da56303, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.941688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05fe1ee-5b2d-45b2-921a-a50d8dfcc9d8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:04.984308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2d45fb-fadb-43ec-bcd6-1fb502df5370 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:04.989149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f24dda-25c4-4b6b-bc85-4263dc725018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:04.990843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f24dda-25c4-4b6b-bc85-4263dc725018 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:04.990843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f24dda-25c4-4b6b-bc85-4263dc725018 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:04.990843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f24dda-25c4-4b6b-bc85-4263dc725018 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:04.991174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f24dda-25c4-4b6b-bc85-4263dc725018 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:04.992952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f24dda-25c4-4b6b-bc85-4263dc725018 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.021926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 763/1530] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:04 2021] PUT /identity/v3/projects/8a1a4405ba004d2b9af81d28eb68feb0/users/020d52200aa747ce8dff02936da56303/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:05.022780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fe1ee-5b2d-45b2-921a-a50d8dfcc9d8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.080082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05fe1ee-5b2d-45b2-921a-a50d8dfcc9d8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.084612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536a48e-2dd4-47d3-8b40-a37f87c1fb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.085261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536a48e-2dd4-47d3-8b40-a37f87c1fb19 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.085534 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536a48e-2dd4-47d3-8b40-a37f87c1fb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.085803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536a48e-2dd4-47d3-8b40-a37f87c1fb19 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.087067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536a48e-2dd4-47d3-8b40-a37f87c1fb19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.088760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536a48e-2dd4-47d3-8b40-a37f87c1fb19 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.098481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 768/1531] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:04 2021] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:05.098481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f24dda-25c4-4b6b-bc85-4263dc725018 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.098738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 764/1532] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:05.099843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536a48e-2dd4-47d3-8b40-a37f87c1fb19 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.107355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f24dda-25c4-4b6b-bc85-4263dc725018 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.110003 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536a48e-2dd4-47d3-8b40-a37f87c1fb19 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.112249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092a64b-2c5c-4286-823d-41fa8f4b3426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.112891 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092a64b-2c5c-4286-823d-41fa8f4b3426 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.113168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092a64b-2c5c-4286-823d-41fa8f4b3426 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.113501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3092a64b-2c5c-4286-823d-41fa8f4b3426 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.114372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092a64b-2c5c-4286-823d-41fa8f4b3426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.114995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386133d-b38c-45cc-be53-7cade13defb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.115630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386133d-b38c-45cc-be53-7cade13defb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.115905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386133d-b38c-45cc-be53-7cade13defb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.116013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3092a64b-2c5c-4286-823d-41fa8f4b3426 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.116172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7386133d-b38c-45cc-be53-7cade13defb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.116961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386133d-b38c-45cc-be53-7cade13defb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.118606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7386133d-b38c-45cc-be53-7cade13defb0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.127981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 769/1533] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:05.133389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 765/1534] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:05.133511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092a64b-2c5c-4286-823d-41fa8f4b3426 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.133603 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386133d-b38c-45cc-be53-7cade13defb0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.140630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3092a64b-2c5c-4286-823d-41fa8f4b3426 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.143342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7386133d-b38c-45cc-be53-7cade13defb0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.145271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39023f-dfd9-4071-b80c-61efb453b634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.145917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39023f-dfd9-4071-b80c-61efb453b634 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.146223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39023f-dfd9-4071-b80c-61efb453b634 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.146491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39023f-dfd9-4071-b80c-61efb453b634 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.147210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39023f-dfd9-4071-b80c-61efb453b634 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.147886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52713a5b-b11c-459b-929c-3aa83fdea1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.148569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52713a5b-b11c-459b-929c-3aa83fdea1ad admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.148768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39023f-dfd9-4071-b80c-61efb453b634 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.148866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52713a5b-b11c-459b-929c-3aa83fdea1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.149578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52713a5b-b11c-459b-929c-3aa83fdea1ad admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.150330 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52713a5b-b11c-459b-929c-3aa83fdea1ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.151937 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52713a5b-b11c-459b-929c-3aa83fdea1ad admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.159632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 770/1535] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:05.160923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f1c20-fc5b-4953-b572-d7889547cc32 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.161284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f1c20-fc5b-4953-b572-d7889547cc32 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.161631 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f1c20-fc5b-4953-b572-d7889547cc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.169536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 766/1536] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:05.169536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fae0a-4db5-4962-a452-1770de8bb54c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.169536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fae0a-4db5-4962-a452-1770de8bb54c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.169536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fae0a-4db5-4962-a452-1770de8bb54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.188777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c28f1c20-fc5b-4953-b572-d7889547cc32 None None] MFA Rules not processed for user `bc03fcc11ac3464aa1bd60833a23a3e3`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:05.189978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c28f1c20-fc5b-4953-b572-d7889547cc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:05.196085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2a5fae0a-4db5-4962-a452-1770de8bb54c None None] MFA Rules not processed for user `020d52200aa747ce8dff02936da56303`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:05.197662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2a5fae0a-4db5-4962-a452-1770de8bb54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:05.252340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 771/1537] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:05 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:05.253187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f1c20-fc5b-4953-b572-d7889547cc32 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.261303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 767/1538] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:05 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:05.265730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fae0a-4db5-4962-a452-1770de8bb54c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.267141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f1c20-fc5b-4953-b572-d7889547cc32 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.272214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993db0d9-c745-4e89-9994-6d4911e9295c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.272396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fae0a-4db5-4962-a452-1770de8bb54c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.274978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993db0d9-c745-4e89-9994-6d4911e9295c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.275251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993db0d9-c745-4e89-9994-6d4911e9295c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.275517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993db0d9-c745-4e89-9994-6d4911e9295c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.276244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993db0d9-c745-4e89-9994-6d4911e9295c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.277673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81fb9-8053-44d2-8cf5-423e46975172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.277835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993db0d9-c745-4e89-9994-6d4911e9295c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.278362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81fb9-8053-44d2-8cf5-423e46975172 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.278671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81fb9-8053-44d2-8cf5-423e46975172 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.278965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f81fb9-8053-44d2-8cf5-423e46975172 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.279708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f81fb9-8053-44d2-8cf5-423e46975172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.281268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f81fb9-8053-44d2-8cf5-423e46975172 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.292250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 772/1539] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:05.292250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993db0d9-c745-4e89-9994-6d4911e9295c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.292538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 768/1540] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:05.293085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81fb9-8053-44d2-8cf5-423e46975172 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.302595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f81fb9-8053-44d2-8cf5-423e46975172 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.303928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993db0d9-c745-4e89-9994-6d4911e9295c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.308070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381cd4e-dc91-4bbb-ae67-1681622c911c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.308906 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e53ef1-1ef8-4c2c-b136-81bfee2bdd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.309045 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381cd4e-dc91-4bbb-ae67-1681622c911c admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.309325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381cd4e-dc91-4bbb-ae67-1681622c911c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.309605 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381cd4e-dc91-4bbb-ae67-1681622c911c admin admin] PATH_INFO: `/v3/projects/7ac535690bf24eb9bbf7d42426b21c74/users/1ac05d2fe5fa40b4a18063d0d335d9e2/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.309781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53ef1-1ef8-4c2c-b136-81bfee2bdd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.310084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53ef1-1ef8-4c2c-b136-81bfee2bdd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.310712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e53ef1-1ef8-4c2c-b136-81bfee2bdd11 admin admin] PATH_INFO: `/v3/projects/08338b7cd30a4c0fa7c07ecb1bd65bcc/users/b1463a297bac4309bf7868a8176fca08/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.325383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381cd4e-dc91-4bbb-ae67-1681622c911c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ac535690bf24eb9bbf7d42426b21c74, user_id=1ac05d2fe5fa40b4a18063d0d335d9e2, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.327879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e53ef1-1ef8-4c2c-b136-81bfee2bdd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08338b7cd30a4c0fa7c07ecb1bd65bcc, user_id=b1463a297bac4309bf7868a8176fca08, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.328164 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381cd4e-dc91-4bbb-ae67-1681622c911c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.331549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e53ef1-1ef8-4c2c-b136-81bfee2bdd11 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.421607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 769/1541] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:05 2021] PUT /identity/v3/projects/7ac535690bf24eb9bbf7d42426b21c74/users/1ac05d2fe5fa40b4a18063d0d335d9e2/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:05.421817 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 773/1542] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:05 2021] PUT /identity/v3/projects/08338b7cd30a4c0fa7c07ecb1bd65bcc/users/b1463a297bac4309bf7868a8176fca08/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:05.423174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381cd4e-dc91-4bbb-ae67-1681622c911c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.423814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e53ef1-1ef8-4c2c-b136-81bfee2bdd11 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.483681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381cd4e-dc91-4bbb-ae67-1681622c911c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.485229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e53ef1-1ef8-4c2c-b136-81bfee2bdd11 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.488536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff365a-6def-47ff-92ca-acb7f0358405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.489192 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff365a-6def-47ff-92ca-acb7f0358405 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.489472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff365a-6def-47ff-92ca-acb7f0358405 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.489743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff365a-6def-47ff-92ca-acb7f0358405 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.490080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a93e70b-eea9-477f-9803-ae1151315e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.490507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff365a-6def-47ff-92ca-acb7f0358405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.490952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93e70b-eea9-477f-9803-ae1151315e47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.491222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93e70b-eea9-477f-9803-ae1151315e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.491490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a93e70b-eea9-477f-9803-ae1151315e47 admin admin] PATH_INFO: `/v3/projects/ba4a231d73f5454eb53e08db96f0a471/users/e97b78644a8046da928880c62b18253d/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.492195 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff365a-6def-47ff-92ca-acb7f0358405 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.502188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 770/1543] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:05.502976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff365a-6def-47ff-92ca-acb7f0358405 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.505611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93e70b-eea9-477f-9803-ae1151315e47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba4a231d73f5454eb53e08db96f0a471, user_id=e97b78644a8046da928880c62b18253d, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.508272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a93e70b-eea9-477f-9803-ae1151315e47 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.513424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff365a-6def-47ff-92ca-acb7f0358405 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.518002 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd477a30-963f-44c6-bdb6-ce13f0ea97ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.518662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd477a30-963f-44c6-bdb6-ce13f0ea97ab admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.525548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd477a30-963f-44c6-bdb6-ce13f0ea97ab admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.525548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd477a30-963f-44c6-bdb6-ce13f0ea97ab admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.525548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd477a30-963f-44c6-bdb6-ce13f0ea97ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.525548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd477a30-963f-44c6-bdb6-ce13f0ea97ab admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.644711 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 774/1544] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:05 2021] PUT /identity/v3/projects/ba4a231d73f5454eb53e08db96f0a471/users/e97b78644a8046da928880c62b18253d/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:05.646236 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c22707-791a-4f24-a94b-07ccc67f229e None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.646519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c22707-791a-4f24-a94b-07ccc67f229e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.646955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c22707-791a-4f24-a94b-07ccc67f229e None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.648746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 775/1545] 10.222.0.32 () {54 vars in 960 bytes} [Wed Oct 27 01:19:05 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:19:05.650109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c22707-791a-4f24-a94b-07ccc67f229e None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.677674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 771/1546] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:05 2021] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:05.677674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd477a30-963f-44c6-bdb6-ce13f0ea97ab admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.711004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c22707-791a-4f24-a94b-07ccc67f229e None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.736047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd477a30-963f-44c6-bdb6-ce13f0ea97ab admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.740700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721b133-aafd-4c28-abb2-c8e8725105a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.741573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721b133-aafd-4c28-abb2-c8e8725105a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.741954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721b133-aafd-4c28-abb2-c8e8725105a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.742257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0721b133-aafd-4c28-abb2-c8e8725105a9 admin admin] PATH_INFO: `/v3/projects/341b274900784c5f8f6e3b7f10f80cc8/users/b11b35bf64df44739ab333b4f130d23a/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.756387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721b133-aafd-4c28-abb2-c8e8725105a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341b274900784c5f8f6e3b7f10f80cc8, user_id=b11b35bf64df44739ab333b4f130d23a, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.759739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0721b133-aafd-4c28-abb2-c8e8725105a9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.765941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e42f21d-a9fb-4de4-a2ed-44c613af8fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.766635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f21d-a9fb-4de4-a2ed-44c613af8fe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.766916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f21d-a9fb-4de4-a2ed-44c613af8fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.767191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e42f21d-a9fb-4de4-a2ed-44c613af8fe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.767922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42f21d-a9fb-4de4-a2ed-44c613af8fe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.769608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e42f21d-a9fb-4de4-a2ed-44c613af8fe3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.779192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 776/1547] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:05 2021] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:05.780459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90a09f-fbba-4e6e-b062-96e897a75c93 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.780745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90a09f-fbba-4e6e-b062-96e897a75c93 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.781020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90a09f-fbba-4e6e-b062-96e897a75c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.797568 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-0c90a09f-fbba-4e6e-b062-96e897a75c93 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:05.798842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0c90a09f-fbba-4e6e-b062-96e897a75c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:05.807125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 777/1548] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:05.808384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cc2df-38bc-4b7a-ad66-b7ffcc45576d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.808666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cc2df-38bc-4b7a-ad66-b7ffcc45576d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.808932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5cc2df-38bc-4b7a-ad66-b7ffcc45576d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.833894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-cf5cc2df-38bc-4b7a-ad66-b7ffcc45576d None None] MFA Rules not processed for user `b1463a297bac4309bf7868a8176fca08`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:05.835075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-cf5cc2df-38bc-4b7a-ad66-b7ffcc45576d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:05.844414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 772/1549] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:05 2021] PUT /identity/v3/projects/341b274900784c5f8f6e3b7f10f80cc8/users/b11b35bf64df44739ab333b4f130d23a/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:05.845130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721b133-aafd-4c28-abb2-c8e8725105a9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:05.896394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 778/1550] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:05 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:05.897977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c556-0466-4411-b057-d9747164fa66 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.898435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c556-0466-4411-b057-d9747164fa66 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.898860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415c556-0466-4411-b057-d9747164fa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.903761 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0721b133-aafd-4c28-abb2-c8e8725105a9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:05.908463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890d095-ec51-4c8a-b6c5-5484033fa3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:05.909343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890d095-ec51-4c8a-b6c5-5484033fa3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.909629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890d095-ec51-4c8a-b6c5-5484033fa3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.909907 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890d095-ec51-4c8a-b6c5-5484033fa3f7 admin admin] PATH_INFO: `/v3/projects/6304b3ad2b4e4bf398ccbae70b72f46d/users/ff1374f1e319492da48f32b53c91f3ac/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.918151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f415c556-0466-4411-b057-d9747164fa66 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:05.919347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f415c556-0466-4411-b057-d9747164fa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:05.924291 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890d095-ec51-4c8a-b6c5-5484033fa3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6304b3ad2b4e4bf398ccbae70b72f46d, user_id=ff1374f1e319492da48f32b53c91f3ac, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:05.926952 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c890d095-ec51-4c8a-b6c5-5484033fa3f7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:05.927065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 779/1551] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:05 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:05.930810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bb72-2a74-4b29-be0f-fa40fa603336 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:05.930810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bb72-2a74-4b29-be0f-fa40fa603336 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:05.930810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9bb72-2a74-4b29-be0f-fa40fa603336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:05.947777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4cd9bb72-2a74-4b29-be0f-fa40fa603336 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:05.951172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4cd9bb72-2a74-4b29-be0f-fa40fa603336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:06.010667 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 773/1552] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:05 2021] PUT /identity/v3/projects/6304b3ad2b4e4bf398ccbae70b72f46d/users/ff1374f1e319492da48f32b53c91f3ac/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:06.014502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 780/1553] 10.222.0.32 () {58 vars in 1057 bytes} [Wed Oct 27 01:19:05 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:06.015011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890d095-ec51-4c8a-b6c5-5484033fa3f7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.015366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bb72-2a74-4b29-be0f-fa40fa603336 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.025722 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9bb72-2a74-4b29-be0f-fa40fa603336 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.075809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890d095-ec51-4c8a-b6c5-5484033fa3f7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.079538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646488f9-2e00-4ac8-acc7-fffffea38226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.080420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646488f9-2e00-4ac8-acc7-fffffea38226 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.080539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b20212-dbcf-4a1f-8fe6-24639be96e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.080696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646488f9-2e00-4ac8-acc7-fffffea38226 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.080965 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646488f9-2e00-4ac8-acc7-fffffea38226 admin admin] PATH_INFO: `/v3/projects/4a926bd5e8724a67805793952637c5af/users/e5adbf9794344f89b56ac14f09ac6851/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.081074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20212-dbcf-4a1f-8fe6-24639be96e49 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.081346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20212-dbcf-4a1f-8fe6-24639be96e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.081614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b20212-dbcf-4a1f-8fe6-24639be96e49 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.082347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b20212-dbcf-4a1f-8fe6-24639be96e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.084230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b20212-dbcf-4a1f-8fe6-24639be96e49 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.095350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646488f9-2e00-4ac8-acc7-fffffea38226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a926bd5e8724a67805793952637c5af, user_id=e5adbf9794344f89b56ac14f09ac6851, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.098017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646488f9-2e00-4ac8-acc7-fffffea38226 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.193352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 774/1554] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:06 2021] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:06.194132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b20212-dbcf-4a1f-8fe6-24639be96e49 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.195701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e8b20212-dbcf-4a1f-8fe6-24639be96e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:06.223010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 781/1555] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:06 2021] PUT /identity/v3/projects/4a926bd5e8724a67805793952637c5af/users/e5adbf9794344f89b56ac14f09ac6851/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:06.233754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3ec51-f3e9-430f-9364-f311f43f3aab None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.233754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3ec51-f3e9-430f-9364-f311f43f3aab None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.233754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc3ec51-f3e9-430f-9364-f311f43f3aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.244071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-abc3ec51-f3e9-430f-9364-f311f43f3aab None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:06.245257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-abc3ec51-f3e9-430f-9364-f311f43f3aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:06.251127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b20212-dbcf-4a1f-8fe6-24639be96e49 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.297219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d43f279-0146-451d-ba93-e7bc9b1be97f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.297865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43f279-0146-451d-ba93-e7bc9b1be97f service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.298174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43f279-0146-451d-ba93-e7bc9b1be97f service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.298446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d43f279-0146-451d-ba93-e7bc9b1be97f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.301167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 782/1556] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:06.304559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d732f20-a562-4a6c-9f25-b2a97f2ac889 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.304559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d732f20-a562-4a6c-9f25-b2a97f2ac889 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.304559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d732f20-a562-4a6c-9f25-b2a97f2ac889 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.305169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 783/1557] 10.222.0.32 () {54 vars in 960 bytes} [Wed Oct 27 01:19:06 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:19:06.306385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d732f20-a562-4a6c-9f25-b2a97f2ac889 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.316756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d732f20-a562-4a6c-9f25-b2a97f2ac889 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.317242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43f279-0146-451d-ba93-e7bc9b1be97f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.318993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d43f279-0146-451d-ba93-e7bc9b1be97f service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.320351 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322202-5aeb-4cbe-8e5d-c8688f3a2609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.321290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322202-5aeb-4cbe-8e5d-c8688f3a2609 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.321571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322202-5aeb-4cbe-8e5d-c8688f3a2609 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.321841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5322202-5aeb-4cbe-8e5d-c8688f3a2609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.328321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 775/1558] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:06.329561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ee72-6a05-4fc5-ba04-fe06a157eee2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.329840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ee72-6a05-4fc5-ba04-fe06a157eee2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.330142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ee72-6a05-4fc5-ba04-fe06a157eee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.330964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5322202-5aeb-4cbe-8e5d-c8688f3a2609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.332382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5322202-5aeb-4cbe-8e5d-c8688f3a2609 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.342577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 784/1559] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:06.343711 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322202-5aeb-4cbe-8e5d-c8688f3a2609 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.346992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ae61ee72-6a05-4fc5-ba04-fe06a157eee2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:06.348198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ae61ee72-6a05-4fc5-ba04-fe06a157eee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:06.356991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 776/1560] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:06.358548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ee72-6a05-4fc5-ba04-fe06a157eee2 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.369828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ee72-6a05-4fc5-ba04-fe06a157eee2 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.374630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212f1ef-5c85-4ee7-a5f7-eaf30cfd2558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.375289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212f1ef-5c85-4ee7-a5f7-eaf30cfd2558 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.375562 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212f1ef-5c85-4ee7-a5f7-eaf30cfd2558 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.375830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212f1ef-5c85-4ee7-a5f7-eaf30cfd2558 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.376568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212f1ef-5c85-4ee7-a5f7-eaf30cfd2558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.378179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7212f1ef-5c85-4ee7-a5f7-eaf30cfd2558 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.388236 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 777/1561] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:06.389538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef2b4a-3fd5-4de9-baf1-02e37c4ed61e None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.389824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef2b4a-3fd5-4de9-baf1-02e37c4ed61e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.390115 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef2b4a-3fd5-4de9-baf1-02e37c4ed61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.414469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5322202-5aeb-4cbe-8e5d-c8688f3a2609 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.416341 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-82ef2b4a-3fd5-4de9-baf1-02e37c4ed61e None None] MFA Rules not processed for user `e5adbf9794344f89b56ac14f09ac6851`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:06.417528 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-82ef2b4a-3fd5-4de9-baf1-02e37c4ed61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:06.420704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf857b-b9a0-45a3-a190-4c2034346662 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.421348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf857b-b9a0-45a3-a190-4c2034346662 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.421627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf857b-b9a0-45a3-a190-4c2034346662 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.421897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf857b-b9a0-45a3-a190-4c2034346662 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.481110 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf857b-b9a0-45a3-a190-4c2034346662 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.481841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 778/1562] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:06 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:06.483047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471a9ca-8533-4e8a-987d-30f6ece94234 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.483333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471a9ca-8533-4e8a-987d-30f6ece94234 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.483694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471a9ca-8533-4e8a-987d-30f6ece94234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.486728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf857b-b9a0-45a3-a190-4c2034346662 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.497337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 785/1563] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:06 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:06.498277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf857b-b9a0-45a3-a190-4c2034346662 service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.504877 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0471a9ca-8533-4e8a-987d-30f6ece94234 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:06.506684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0471a9ca-8533-4e8a-987d-30f6ece94234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:06.506879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf857b-b9a0-45a3-a190-4c2034346662 service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.511166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c3f5f-b0f3-4fb6-bd55-8acba37fc05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.511785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c3f5f-b0f3-4fb6-bd55-8acba37fc05f service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.512060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c3f5f-b0f3-4fb6-bd55-8acba37fc05f service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.512328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c3f5f-b0f3-4fb6-bd55-8acba37fc05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.519622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 779/1564] 10.222.0.32 () {58 vars in 1057 bytes} [Wed Oct 27 01:19:06 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:06.520694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471a9ca-8533-4e8a-987d-30f6ece94234 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.522576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c3f5f-b0f3-4fb6-bd55-8acba37fc05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.524274 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c3f5f-b0f3-4fb6-bd55-8acba37fc05f service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.531458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471a9ca-8533-4e8a-987d-30f6ece94234 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.535317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 786/1565] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:06.536089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f98ea8-ffb5-4087-ab97-8d584f61c21e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.536314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c3f5f-b0f3-4fb6-bd55-8acba37fc05f service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.537277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f98ea8-ffb5-4087-ab97-8d584f61c21e service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.537776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f98ea8-ffb5-4087-ab97-8d584f61c21e service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.538309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f98ea8-ffb5-4087-ab97-8d584f61c21e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.546560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c3f5f-b0f3-4fb6-bd55-8acba37fc05f service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.550763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f98ea8-ffb5-4087-ab97-8d584f61c21e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.550986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2a400-1a52-4bfa-b693-76e225821561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.552025 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a400-1a52-4bfa-b693-76e225821561 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.552306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a400-1a52-4bfa-b693-76e225821561 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.552577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2a400-1a52-4bfa-b693-76e225821561 admin admin] PATH_INFO: `/v3/projects/b233cff3fff348d5b8b512554a65cbe9/users/6ef5d4e73f764b9cb58f0f176a1dfb65/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.553076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f98ea8-ffb5-4087-ab97-8d584f61c21e service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.564672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 780/1566] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:06 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:06.568984 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2a400-1a52-4bfa-b693-76e225821561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b233cff3fff348d5b8b512554a65cbe9, user_id=6ef5d4e73f764b9cb58f0f176a1dfb65, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.576789 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2a400-1a52-4bfa-b693-76e225821561 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.576919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f98ea8-ffb5-4087-ab97-8d584f61c21e service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.585082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f98ea8-ffb5-4087-ab97-8d584f61c21e service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.589860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32508d7-07a9-4406-96b3-dbf5572972c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.590556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32508d7-07a9-4406-96b3-dbf5572972c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.590832 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32508d7-07a9-4406-96b3-dbf5572972c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.591128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32508d7-07a9-4406-96b3-dbf5572972c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.591817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32508d7-07a9-4406-96b3-dbf5572972c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.593779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32508d7-07a9-4406-96b3-dbf5572972c7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.642470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 787/1567] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:06 2021] PUT /identity/v3/projects/b233cff3fff348d5b8b512554a65cbe9/users/6ef5d4e73f764b9cb58f0f176a1dfb65/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:06.647994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2a400-1a52-4bfa-b693-76e225821561 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.675504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 781/1568] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:06 2021] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:06.675504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32508d7-07a9-4406-96b3-dbf5572972c7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.766500 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2a400-1a52-4bfa-b693-76e225821561 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.798183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32508d7-07a9-4406-96b3-dbf5572972c7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.805107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ba38b-f968-4261-a4c2-8e4db38c1a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.806511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ba38b-f968-4261-a4c2-8e4db38c1a20 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.806861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ba38b-f968-4261-a4c2-8e4db38c1a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.807575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ba38b-f968-4261-a4c2-8e4db38c1a20 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.808762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ba38b-f968-4261-a4c2-8e4db38c1a20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.810924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ba38b-f968-4261-a4c2-8e4db38c1a20 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.827124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 782/1569] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:06 2021] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:06.828139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ba38b-f968-4261-a4c2-8e4db38c1a20 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.840618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ba38b-f968-4261-a4c2-8e4db38c1a20 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.845636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96727b87-bc33-4323-809e-4e68085609ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.846194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96727b87-bc33-4323-809e-4e68085609ea admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.846478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96727b87-bc33-4323-809e-4e68085609ea admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.846758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96727b87-bc33-4323-809e-4e68085609ea admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.847495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96727b87-bc33-4323-809e-4e68085609ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.857699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96727b87-bc33-4323-809e-4e68085609ea admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.858194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d9e1f-2fd8-45d3-87f7-fae9323741a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.858800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d9e1f-2fd8-45d3-87f7-fae9323741a2 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.859111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d9e1f-2fd8-45d3-87f7-fae9323741a2 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.859515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527d9e1f-2fd8-45d3-87f7-fae9323741a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.920726 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d9e1f-2fd8-45d3-87f7-fae9323741a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.922681 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527d9e1f-2fd8-45d3-87f7-fae9323741a2 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.932501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 788/1570] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:06 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:06.949412 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d9e1f-2fd8-45d3-87f7-fae9323741a2 service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:06.975970 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527d9e1f-2fd8-45d3-87f7-fae9323741a2 service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:06.980811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 783/1571] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:06 2021] POST /identity/v3/users => generated 294 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:06.980811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0163f-06c4-4764-b61b-d381acff7df9 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.980811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0163f-06c4-4764-b61b-d381acff7df9 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.980811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0163f-06c4-4764-b61b-d381acff7df9 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.988160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d6998a-3c15-4256-8046-5f0055328f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:06.989242 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6998a-3c15-4256-8046-5f0055328f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:06.989368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6998a-3c15-4256-8046-5f0055328f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:06.989583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d6998a-3c15-4256-8046-5f0055328f39 admin admin] PATH_INFO: `/v3/projects/b233cff3fff348d5b8b512554a65cbe9/users/6ef5d4e73f764b9cb58f0f176a1dfb65/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:06.993679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6998a-3c15-4256-8046-5f0055328f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b233cff3fff348d5b8b512554a65cbe9, user_id=6ef5d4e73f764b9cb58f0f176a1dfb65, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:06.996280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 784/1572] 10.222.0.32 () {54 vars in 912 bytes} [Wed Oct 27 01:19:06 2021] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:19:06.996432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d6998a-3c15-4256-8046-5f0055328f39 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:06.997800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0163f-06c4-4764-b61b-d381acff7df9 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:07.017509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0163f-06c4-4764-b61b-d381acff7df9 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:07.022957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 789/1573] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:06 2021] PUT /identity/v3/projects/b233cff3fff348d5b8b512554a65cbe9/users/6ef5d4e73f764b9cb58f0f176a1dfb65/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:07.024337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ccdde-0849-4195-aed1-789356377657 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.024621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ccdde-0849-4195-aed1-789356377657 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.024912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ccdde-0849-4195-aed1-789356377657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.070326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-827ccdde-0849-4195-aed1-789356377657 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:07.075775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-827ccdde-0849-4195-aed1-789356377657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:07.127721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d96ca-764b-4b26-8470-241044804da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:07.128499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d96ca-764b-4b26-8470-241044804da0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.130017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d96ca-764b-4b26-8470-241044804da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.130323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d96ca-764b-4b26-8470-241044804da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.132243 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d96ca-764b-4b26-8470-241044804da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:07.135533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d96ca-764b-4b26-8470-241044804da0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:07.161760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 785/1574] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:06 2021] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:07.163739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2d365-fc58-48af-bce1-793b61f79d02 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.164118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2d365-fc58-48af-bce1-793b61f79d02 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.164400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2d365-fc58-48af-bce1-793b61f79d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.200327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f7a2d365-fc58-48af-bce1-793b61f79d02 None None] MFA Rules not processed for user `6ef5d4e73f764b9cb58f0f176a1dfb65`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:07.201930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f7a2d365-fc58-48af-bce1-793b61f79d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:07.221508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 790/1575] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:19:07 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:07.222405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ccdde-0849-4195-aed1-789356377657 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:07.252472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ccdde-0849-4195-aed1-789356377657 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:07.283221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39a0e8-3dee-4316-8b47-a17af56488a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:07.285935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39a0e8-3dee-4316-8b47-a17af56488a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.285935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39a0e8-3dee-4316-8b47-a17af56488a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.286313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39a0e8-3dee-4316-8b47-a17af56488a5 admin admin] PATH_INFO: `/v3/projects/b94552ad731746ca9b17af5642f2a49b/users/21e74ee256824efd96b0a84237efc57f/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.301920 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 786/1576] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:07 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:07.303004 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2d365-fc58-48af-bce1-793b61f79d02 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:07.316504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39a0e8-3dee-4316-8b47-a17af56488a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94552ad731746ca9b17af5642f2a49b, user_id=21e74ee256824efd96b0a84237efc57f, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:07.321382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39a0e8-3dee-4316-8b47-a17af56488a5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:07.366358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2d365-fc58-48af-bce1-793b61f79d02 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:07.371210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5d20e6-7b75-48cc-8cb3-7b2c4a2ec6f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:07.371896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d20e6-7b75-48cc-8cb3-7b2c4a2ec6f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.372360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d20e6-7b75-48cc-8cb3-7b2c4a2ec6f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.372708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5d20e6-7b75-48cc-8cb3-7b2c4a2ec6f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.385140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d20e6-7b75-48cc-8cb3-7b2c4a2ec6f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:07.386975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5d20e6-7b75-48cc-8cb3-7b2c4a2ec6f8 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:07.399485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 787/1577] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:07.401376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580af3a2-0582-4bbf-9a0e-b0643f16a71e None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.403980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580af3a2-0582-4bbf-9a0e-b0643f16a71e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.403980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580af3a2-0582-4bbf-9a0e-b0643f16a71e None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.404268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 788/1578] 10.222.0.32 () {54 vars in 912 bytes} [Wed Oct 27 01:19:07 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:19:07.404960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580af3a2-0582-4bbf-9a0e-b0643f16a71e None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:07.417730 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 791/1579] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:07 2021] PUT /identity/v3/projects/b94552ad731746ca9b17af5642f2a49b/users/21e74ee256824efd96b0a84237efc57f/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:07.419084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fdaf-7ba8-4e4e-bb9f-cdd282a81c48 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.427254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fdaf-7ba8-4e4e-bb9f-cdd282a81c48 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.427254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4fdaf-7ba8-4e4e-bb9f-cdd282a81c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.453694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9af4fdaf-7ba8-4e4e-bb9f-cdd282a81c48 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:07.455910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9af4fdaf-7ba8-4e4e-bb9f-cdd282a81c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:07.494096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580af3a2-0582-4bbf-9a0e-b0643f16a71e None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:07.498509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe124f4-cf8b-488d-9e6f-8f7c0e486310 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:07.499454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe124f4-cf8b-488d-9e6f-8f7c0e486310 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.500020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe124f4-cf8b-488d-9e6f-8f7c0e486310 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.500916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe124f4-cf8b-488d-9e6f-8f7c0e486310 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.571743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 792/1580] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:19:07 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:07.580005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4fdaf-7ba8-4e4e-bb9f-cdd282a81c48 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:07.636000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe124f4-cf8b-488d-9e6f-8f7c0e486310 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:07.642935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe124f4-cf8b-488d-9e6f-8f7c0e486310 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:07.670657 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 789/1581] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:07 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:07.675354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe124f4-cf8b-488d-9e6f-8f7c0e486310 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:07.688503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe124f4-cf8b-488d-9e6f-8f7c0e486310 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:07.693080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89bc1e-ba9f-411d-b0bd-b68cc5118362 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:07.693745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89bc1e-ba9f-411d-b0bd-b68cc5118362 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.694143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89bc1e-ba9f-411d-b0bd-b68cc5118362 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.694421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e89bc1e-ba9f-411d-b0bd-b68cc5118362 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.703914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4fdaf-7ba8-4e4e-bb9f-cdd282a81c48 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:07.707645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89bc1e-ba9f-411d-b0bd-b68cc5118362 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:07.710180 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e89bc1e-ba9f-411d-b0bd-b68cc5118362 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:07.717235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bedd488-a04e-4d65-9163-78e9adc89d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:07.719170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedd488-a04e-4d65-9163-78e9adc89d53 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.719460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedd488-a04e-4d65-9163-78e9adc89d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.720526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bedd488-a04e-4d65-9163-78e9adc89d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.721286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bedd488-a04e-4d65-9163-78e9adc89d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:07.724576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bedd488-a04e-4d65-9163-78e9adc89d53 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:07.728697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 790/1582] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:07 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:07.748146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 793/1583] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:07 2021] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:07.749985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89bc1e-ba9f-411d-b0bd-b68cc5118362 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:07.765650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e89bc1e-ba9f-411d-b0bd-b68cc5118362 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:07.771179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaf050-4fe1-4268-b94b-e5c3c9c887f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:07.772329 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaf050-4fe1-4268-b94b-e5c3c9c887f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.772607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaf050-4fe1-4268-b94b-e5c3c9c887f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.772885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbaf050-4fe1-4268-b94b-e5c3c9c887f5 admin admin] PATH_INFO: `/v3/projects/b94552ad731746ca9b17af5642f2a49b/users/21e74ee256824efd96b0a84237efc57f/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.775266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbaf050-4fe1-4268-b94b-e5c3c9c887f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b94552ad731746ca9b17af5642f2a49b, user_id=21e74ee256824efd96b0a84237efc57f, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:07.777915 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbaf050-4fe1-4268-b94b-e5c3c9c887f5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:07.790254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 791/1584] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:07 2021] PUT /identity/v3/projects/b94552ad731746ca9b17af5642f2a49b/users/21e74ee256824efd96b0a84237efc57f/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:07.801524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e25c-b257-40e0-979b-3f4e1e57c284 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:07.802018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e25c-b257-40e0-979b-3f4e1e57c284 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:07.802433 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e25c-b257-40e0-979b-3f4e1e57c284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:07.840765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e300e25c-b257-40e0-979b-3f4e1e57c284 None None] MFA Rules not processed for user `21e74ee256824efd96b0a84237efc57f`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:07.842472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e300e25c-b257-40e0-979b-3f4e1e57c284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:07.966049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 794/1585] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:07 2021] POST /identity/v3/auth/tokens => generated 3462 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:08.103790 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaf050-4fe1-4268-b94b-e5c3c9c887f5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:08.181561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbaf050-4fe1-4268-b94b-e5c3c9c887f5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:08.187827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641ed8-5d3a-4fde-8139-451abb5ae7a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:08.189166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641ed8-5d3a-4fde-8139-451abb5ae7a2 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:08.189545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641ed8-5d3a-4fde-8139-451abb5ae7a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:08.190494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41641ed8-5d3a-4fde-8139-451abb5ae7a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:08.261936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41641ed8-5d3a-4fde-8139-451abb5ae7a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:08.263538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41641ed8-5d3a-4fde-8139-451abb5ae7a2 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:08.273373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 792/1586] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:08 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:08.886333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e25c-b257-40e0-979b-3f4e1e57c284 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:08.892221 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641ed8-5d3a-4fde-8139-451abb5ae7a2 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:08.897761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e25c-b257-40e0-979b-3f4e1e57c284 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:08.902765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2e8dd-1777-46d2-b1cd-196b11f16227 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:08.903572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2e8dd-1777-46d2-b1cd-196b11f16227 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:08.904002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2e8dd-1777-46d2-b1cd-196b11f16227 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:08.904377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2e8dd-1777-46d2-b1cd-196b11f16227 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:09.023838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2e8dd-1777-46d2-b1cd-196b11f16227 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:09.025377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc2e8dd-1777-46d2-b1cd-196b11f16227 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:09.040101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 795/1587] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:08 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:09.058747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756505-d194-4cb7-bc0d-efe3141d2c17 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:09.059335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756505-d194-4cb7-bc0d-efe3141d2c17 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:09.059613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7756505-d194-4cb7-bc0d-efe3141d2c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:09.063121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41641ed8-5d3a-4fde-8139-451abb5ae7a2 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:09.069317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:09.072289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:09.072774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:09.073308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] PATH_INFO: `/v3/users/020d52200aa747ce8dff02936da56303` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:09.074937 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=020d52200aa747ce8dff02936da56303)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:09.078230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:09.103765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e7756505-d194-4cb7-bc0d-efe3141d2c17 None None] MFA Rules not processed for user `b11b35bf64df44739ab333b4f130d23a`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:09.106265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e7756505-d194-4cb7-bc0d-efe3141d2c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:09.210776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 796/1588] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:09 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:09.224486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06967f6-1e55-4205-b663-1a9763f62bd6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:09.224775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06967f6-1e55-4205-b663-1a9763f62bd6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:09.225066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06967f6-1e55-4205-b663-1a9763f62bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:09.248785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f06967f6-1e55-4205-b663-1a9763f62bd6 None None] MFA Rules not processed for user `b11b35bf64df44739ab333b4f130d23a`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:09.249989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f06967f6-1e55-4205-b663-1a9763f62bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:09.264164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 797/1589] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:09 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:09.271375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06967f6-1e55-4205-b663-1a9763f62bd6 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:09.367410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06967f6-1e55-4205-b663-1a9763f62bd6 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:09.382238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77a29bd-2605-4dc7-92f9-e7b05b1ecceb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:09.383568 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a29bd-2605-4dc7-92f9-e7b05b1ecceb service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:09.384011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a29bd-2605-4dc7-92f9-e7b05b1ecceb service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:09.384770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77a29bd-2605-4dc7-92f9-e7b05b1ecceb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:09.384922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '020d52200aa747ce8dff02936da56303'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:09.399612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a29bd-2605-4dc7-92f9-e7b05b1ecceb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:09.401911 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77a29bd-2605-4dc7-92f9-e7b05b1ecceb service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:09.404556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '020d52200aa747ce8dff02936da56303'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:09.414248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 798/1590] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:09 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:09.429641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '020d52200aa747ce8dff02936da56303'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:09.431080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '020d52200aa747ce8dff02936da56303'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:09.506889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '020d52200aa747ce8dff02936da56303'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:09.536565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 793/1591] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:08 2021] DELETE /identity/v3/users/020d52200aa747ce8dff02936da56303 => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:09.538646 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8c605-5f17-4e5c-9915-95ed9d57d173 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:09.544969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8c605-5f17-4e5c-9915-95ed9d57d173 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:09.544969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f8c605-5f17-4e5c-9915-95ed9d57d173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:09.588198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d9f8c605-5f17-4e5c-9915-95ed9d57d173 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:09.589465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d9f8c605-5f17-4e5c-9915-95ed9d57d173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:09.723255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 799/1592] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:09.764114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:09.765690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:09.930731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4baeee-08c4-40d2-a6c7-4e999aa955a9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:09.936787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248da25-04f2-40f2-b578-a621ece938c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:09.947257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248da25-04f2-40f2-b578-a621ece938c4 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:09.950265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248da25-04f2-40f2-b578-a621ece938c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:09.950599 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248da25-04f2-40f2-b578-a621ece938c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:10.004898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248da25-04f2-40f2-b578-a621ece938c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:10.004898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248da25-04f2-40f2-b578-a621ece938c4 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:10.004898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 794/1593] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:09 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:10.089883 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8ccea-ef13-4882-8c36-d269b694ad5c None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:10.090518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8ccea-ef13-4882-8c36-d269b694ad5c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:10.090518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad8ccea-ef13-4882-8c36-d269b694ad5c None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:10.092576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 800/1594] 10.222.0.32 () {54 vars in 912 bytes} [Wed Oct 27 01:19:10 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:19:10.108840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b9ec0-5500-432d-ab16-e26b49398d5c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:10.109976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b9ec0-5500-432d-ab16-e26b49398d5c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:10.111834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b9ec0-5500-432d-ab16-e26b49398d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:10.171472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e74b9ec0-5500-432d-ab16-e26b49398d5c None None] MFA Rules not processed for user `66c74b04afed4aabbdbee054438a4933`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:10.173099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e74b9ec0-5500-432d-ab16-e26b49398d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:10.185042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 795/1595] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:19:10 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:10.296000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8ccea-ef13-4882-8c36-d269b694ad5c None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:10.307441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad8ccea-ef13-4882-8c36-d269b694ad5c None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:10.311188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ee6f5-1913-4f42-b10f-7c80a9d52bdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:10.313727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ee6f5-1913-4f42-b10f-7c80a9d52bdc service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:10.313727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ee6f5-1913-4f42-b10f-7c80a9d52bdc service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:10.313727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ee6f5-1913-4f42-b10f-7c80a9d52bdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:10.320084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ee6f5-1913-4f42-b10f-7c80a9d52bdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:10.321924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3ee6f5-1913-4f42-b10f-7c80a9d52bdc service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:10.339505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 801/1596] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:10 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:11.091300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b9ec0-5500-432d-ab16-e26b49398d5c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:11.092665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e74b9ec0-5500-432d-ab16-e26b49398d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:11.140426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74b9ec0-5500-432d-ab16-e26b49398d5c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:11.154803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:11.155791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:11.156103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:11.156378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] PATH_INFO: `/v3/projects/8a1a4405ba004d2b9af81d28eb68feb0` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:11.157747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a1a4405ba004d2b9af81d28eb68feb0)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:11.158809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: WARNING py.warnings [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_project failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:11.158809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: warnings.warn(msg) Oct 27 01:19:11.158809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: Oct 27 01:19:11.160010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:11.448438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a1a4405ba004d2b9af81d28eb68feb0', 'request_id': 'req-f2803778-1f37-4c60-b2bd-1f77b097b4e0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:11.477968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a1a4405ba004d2b9af81d28eb68feb0', 'request_id': 'req-f2803778-1f37-4c60-b2bd-1f77b097b4e0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:11.495811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a1a4405ba004d2b9af81d28eb68feb0', 'request_id': 'req-f2803778-1f37-4c60-b2bd-1f77b097b4e0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:11.599595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] The token cache is being invalidate because project 8a1a4405ba004d2b9af81d28eb68feb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:11.599891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:11.600601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:11.603255 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 796/1597] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:11 2021] DELETE /identity/v3/projects/8a1a4405ba004d2b9af81d28eb68feb0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:11.609279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09436c00-03d2-4d31-9ade-930f888177be None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:11.609857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09436c00-03d2-4d31-9ade-930f888177be None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:11.609857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09436c00-03d2-4d31-9ade-930f888177be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:11.658006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-09436c00-03d2-4d31-9ade-930f888177be None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:11.666600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-09436c00-03d2-4d31-9ade-930f888177be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:11.772222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:11.775206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:11.884808 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 802/1598] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:11.891625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab37f0-7146-462e-a4b2-0184154e7739 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:11.891625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab37f0-7146-462e-a4b2-0184154e7739 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:11.891625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ab37f0-7146-462e-a4b2-0184154e7739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:11.966008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-27ab37f0-7146-462e-a4b2-0184154e7739 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:11.967507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-27ab37f0-7146-462e-a4b2-0184154e7739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:11.993194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 803/1599] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:11.997330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab37f0-7146-462e-a4b2-0184154e7739 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:12.014929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ab37f0-7146-462e-a4b2-0184154e7739 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:12.027940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f98ed-8f8c-4d59-8959-a78dc069d3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:12.033490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f98ed-8f8c-4d59-8959-a78dc069d3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:12.034054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f98ed-8f8c-4d59-8959-a78dc069d3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:12.034659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f98ed-8f8c-4d59-8959-a78dc069d3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:12.035486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f98ed-8f8c-4d59-8959-a78dc069d3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:12.036708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f98ed-8f8c-4d59-8959-a78dc069d3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:12.038436 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f98ed-8f8c-4d59-8959-a78dc069d3a1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:12.049634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2803778-1f37-4c60-b2bd-1f77b097b4e0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:12.063352 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 804/1600] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:19:12.071559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f98ed-8f8c-4d59-8959-a78dc069d3a1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:12.072702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa777ae-13cb-4379-a29e-15f11f9d6c56 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8df6e02fde834883aef230f31d6ecd94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:12.073381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa777ae-13cb-4379-a29e-15f11f9d6c56 service placement] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:12.073715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa777ae-13cb-4379-a29e-15f11f9d6c56 service placement] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:12.073998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa777ae-13cb-4379-a29e-15f11f9d6c56 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:12.076634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-9aa777ae-13cb-4379-a29e-15f11f9d6c56 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:12.085392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f98ed-8f8c-4d59-8959-a78dc069d3a1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:12.097879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa777ae-13cb-4379-a29e-15f11f9d6c56 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:12.101046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa777ae-13cb-4379-a29e-15f11f9d6c56 service placement] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:12.105348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cd567-6f5c-4a8a-9abd-1a6a244150c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:12.113353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cd567-6f5c-4a8a-9abd-1a6a244150c1 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:12.113353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cd567-6f5c-4a8a-9abd-1a6a244150c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:12.113353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cd567-6f5c-4a8a-9abd-1a6a244150c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:12.113353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cd567-6f5c-4a8a-9abd-1a6a244150c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:12.113353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64cd567-6f5c-4a8a-9abd-1a6a244150c1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:12.132773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 797/1601] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:11 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:12.241106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 805/1602] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:12 2021] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:12.247549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa777ae-13cb-4379-a29e-15f11f9d6c56 service placement] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:12.264468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa777ae-13cb-4379-a29e-15f11f9d6c56 service placement] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:12.375068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2e479-d381-4db1-a8bb-cdd6edaaa8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:12.375068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e479-d381-4db1-a8bb-cdd6edaaa8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:12.375068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e479-d381-4db1-a8bb-cdd6edaaa8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:12.375412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2e479-d381-4db1-a8bb-cdd6edaaa8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:12.378078 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2e479-d381-4db1-a8bb-cdd6edaaa8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:12.385952 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2e479-d381-4db1-a8bb-cdd6edaaa8e7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:12.491307 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 798/1603] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:12 2021] POST /identity/v3/users => generated 287 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:12.496406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cd567-6f5c-4a8a-9abd-1a6a244150c1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:12.517628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64cd567-6f5c-4a8a-9abd-1a6a244150c1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:12.534561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daf891-d80b-4a13-9db0-3535019ecf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:12.535427 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daf891-d80b-4a13-9db0-3535019ecf43 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:12.536537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daf891-d80b-4a13-9db0-3535019ecf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:12.541446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55daf891-d80b-4a13-9db0-3535019ecf43 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:12.544184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daf891-d80b-4a13-9db0-3535019ecf43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:12.547597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55daf891-d80b-4a13-9db0-3535019ecf43 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:12.570203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 806/1604] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:12 2021] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:12.574931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2e479-d381-4db1-a8bb-cdd6edaaa8e7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:12.590679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2e479-d381-4db1-a8bb-cdd6edaaa8e7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:12.605256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0125a81-5616-423d-b0a6-eca3777e2c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:12.606310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0125a81-5616-423d-b0a6-eca3777e2c44 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:12.606690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0125a81-5616-423d-b0a6-eca3777e2c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:12.607230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0125a81-5616-423d-b0a6-eca3777e2c44 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:12.608213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0125a81-5616-423d-b0a6-eca3777e2c44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:12.614609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0125a81-5616-423d-b0a6-eca3777e2c44 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:12.638398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 799/1605] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:12 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:12.642437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daf891-d80b-4a13-9db0-3535019ecf43 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:12.654094 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55daf891-d80b-4a13-9db0-3535019ecf43 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:12.672812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715d351-be18-4411-ba82-e5e9b197433c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:12.674347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715d351-be18-4411-ba82-e5e9b197433c admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:12.674777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715d351-be18-4411-ba82-e5e9b197433c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:12.675162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d715d351-be18-4411-ba82-e5e9b197433c admin admin] PATH_INFO: `/v3/projects/abf8a871c8134a589fc3a3555dc042dc/users/77e9dd9a950440c0afa35cec37a99db9/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:12.726474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715d351-be18-4411-ba82-e5e9b197433c admin admin] RBAC: Authorizing `identity:create_grant(project_id=abf8a871c8134a589fc3a3555dc042dc, user_id=77e9dd9a950440c0afa35cec37a99db9, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:12.730265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d715d351-be18-4411-ba82-e5e9b197433c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:12.817519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 807/1606] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:12 2021] PUT /identity/v3/projects/abf8a871c8134a589fc3a3555dc042dc/users/77e9dd9a950440c0afa35cec37a99db9/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:12.829459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7139181-2e30-47ba-a8a8-f7ca6a763a20 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:12.829769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7139181-2e30-47ba-a8a8-f7ca6a763a20 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:12.830178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7139181-2e30-47ba-a8a8-f7ca6a763a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:12.892002 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c7139181-2e30-47ba-a8a8-f7ca6a763a20 None None] MFA Rules not processed for user `77e9dd9a950440c0afa35cec37a99db9`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:12.892002 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c7139181-2e30-47ba-a8a8-f7ca6a763a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:13.096574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 800/1607] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:12 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:13.100924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715d351-be18-4411-ba82-e5e9b197433c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:13.214648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d715d351-be18-4411-ba82-e5e9b197433c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:13.224661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfcecc-31fd-4777-8131-0db6fba2786b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:13.225627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfcecc-31fd-4777-8131-0db6fba2786b admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:13.226530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfcecc-31fd-4777-8131-0db6fba2786b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:13.227006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dfcecc-31fd-4777-8131-0db6fba2786b admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:13.228556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfcecc-31fd-4777-8131-0db6fba2786b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:13.231458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dfcecc-31fd-4777-8131-0db6fba2786b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:13.406957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 808/1608] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:13 2021] POST /identity/v3/projects => generated 371 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:13.407172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7139181-2e30-47ba-a8a8-f7ca6a763a20 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:13.427876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7139181-2e30-47ba-a8a8-f7ca6a763a20 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:13.533549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd520-78b2-43dd-ac63-3bd19cfdbef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:13.534196 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd520-78b2-43dd-ac63-3bd19cfdbef8 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:13.534510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd520-78b2-43dd-ac63-3bd19cfdbef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:13.535071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cd520-78b2-43dd-ac63-3bd19cfdbef8 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:13.536111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cd520-78b2-43dd-ac63-3bd19cfdbef8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:13.539245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cd520-78b2-43dd-ac63-3bd19cfdbef8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:13.643772 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 801/1609] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:13 2021] POST /identity/v3/users => generated 292 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:13.648473 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfcecc-31fd-4777-8131-0db6fba2786b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:13.662527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dfcecc-31fd-4777-8131-0db6fba2786b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:13.671644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dec158-440e-4459-acc5-de907e738f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:13.672994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dec158-440e-4459-acc5-de907e738f31 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:13.673438 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dec158-440e-4459-acc5-de907e738f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:13.674281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dec158-440e-4459-acc5-de907e738f31 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:13.675783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dec158-440e-4459-acc5-de907e738f31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:13.678188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dec158-440e-4459-acc5-de907e738f31 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:13.699679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd520-78b2-43dd-ac63-3bd19cfdbef8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:13.701027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 809/1610] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:13 2021] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:13.712822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cd520-78b2-43dd-ac63-3bd19cfdbef8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:13.718369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd10a8-21a2-49ac-b844-a74b38ec9b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:13.720288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd10a8-21a2-49ac-b844-a74b38ec9b94 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:13.720910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd10a8-21a2-49ac-b844-a74b38ec9b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:13.721359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd10a8-21a2-49ac-b844-a74b38ec9b94 admin admin] PATH_INFO: `/v3/projects/724e00c864484e3db38a04985ed892bf/users/d5e0532a6c81469781c73d32c4df2b2d/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:13.746840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd10a8-21a2-49ac-b844-a74b38ec9b94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=724e00c864484e3db38a04985ed892bf, user_id=d5e0532a6c81469781c73d32c4df2b2d, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:13.750478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd10a8-21a2-49ac-b844-a74b38ec9b94 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:13.843904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 802/1611] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:13 2021] PUT /identity/v3/projects/724e00c864484e3db38a04985ed892bf/users/d5e0532a6c81469781c73d32c4df2b2d/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:13.848217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dec158-440e-4459-acc5-de907e738f31 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:13.881932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dec158-440e-4459-acc5-de907e738f31 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:13.990683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178ecbd1-c5e3-4cd4-a9e0-fdffd8a0f96a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:13.991829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecbd1-c5e3-4cd4-a9e0-fdffd8a0f96a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:13.992340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecbd1-c5e3-4cd4-a9e0-fdffd8a0f96a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:13.993330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178ecbd1-c5e3-4cd4-a9e0-fdffd8a0f96a admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:13.994346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ecbd1-c5e3-4cd4-a9e0-fdffd8a0f96a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:13.996442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178ecbd1-c5e3-4cd4-a9e0-fdffd8a0f96a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:14.015473 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd10a8-21a2-49ac-b844-a74b38ec9b94 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:14.015710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 810/1612] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:13 2021] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:14.049857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd10a8-21a2-49ac-b844-a74b38ec9b94 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:14.100251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22263533-6724-4945-88bf-14d1de460f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:14.101316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22263533-6724-4945-88bf-14d1de460f6c admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:14.101597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22263533-6724-4945-88bf-14d1de460f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:14.101901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22263533-6724-4945-88bf-14d1de460f6c admin admin] PATH_INFO: `/v3/projects/724e00c864484e3db38a04985ed892bf/users/d5e0532a6c81469781c73d32c4df2b2d/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:14.108361 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22263533-6724-4945-88bf-14d1de460f6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=724e00c864484e3db38a04985ed892bf, user_id=d5e0532a6c81469781c73d32c4df2b2d, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:14.116367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22263533-6724-4945-88bf-14d1de460f6c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:14.163910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 803/1613] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:14 2021] PUT /identity/v3/projects/724e00c864484e3db38a04985ed892bf/users/d5e0532a6c81469781c73d32c4df2b2d/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:14.164618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc1d00-1c5e-462b-b700-7dda93cf027a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:14.165166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc1d00-1c5e-462b-b700-7dda93cf027a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:14.165596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc1d00-1c5e-462b-b700-7dda93cf027a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:14.224729 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-3bbc1d00-1c5e-462b-b700-7dda93cf027a None None] MFA Rules not processed for user `d5e0532a6c81469781c73d32c4df2b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:14.226227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3bbc1d00-1c5e-462b-b700-7dda93cf027a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:14.323608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 811/1614] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:14 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:14.403440 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22263533-6724-4945-88bf-14d1de460f6c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:14.403440 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-22263533-6724-4945-88bf-14d1de460f6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:14.511772 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22263533-6724-4945-88bf-14d1de460f6c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:14.522500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae54a-6b85-4140-b148-0b77f2425e0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:14.522500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae54a-6b85-4140-b148-0b77f2425e0d service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:14.522500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae54a-6b85-4140-b148-0b77f2425e0d service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:14.522500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827ae54a-6b85-4140-b148-0b77f2425e0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:14.541788 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ae54a-6b85-4140-b148-0b77f2425e0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:14.543368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827ae54a-6b85-4140-b148-0b77f2425e0d service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:14.568499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 804/1615] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:14 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:15.670889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc1d00-1c5e-462b-b700-7dda93cf027a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:15.762428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc1d00-1c5e-462b-b700-7dda93cf027a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:15.778555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:15.780040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:15.780474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:15.780894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] PATH_INFO: `/v3/users/77e9dd9a950440c0afa35cec37a99db9` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:15.782487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] RBAC: Authorizing `identity:delete_user(user_id=77e9dd9a950440c0afa35cec37a99db9)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:15.784479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: WARNING py.warnings [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1075: UserWarning: Policy identity:delete_user failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 27 01:19:15.784479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: warnings.warn(msg) Oct 27 01:19:15.784479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: Oct 27 01:19:15.786334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:16.059271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae54a-6b85-4140-b148-0b77f2425e0d service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:16.069955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827ae54a-6b85-4140-b148-0b77f2425e0d service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:16.085508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:16.086839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:16.087125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:16.087395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:16.094930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:16.124059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77e9dd9a950440c0afa35cec37a99db9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:16.153774 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77e9dd9a950440c0afa35cec37a99db9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:16.179860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77e9dd9a950440c0afa35cec37a99db9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:16.232032 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:16.233578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:16.280616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77e9dd9a950440c0afa35cec37a99db9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:16.280616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ed2dbd40-2931-44be-a236-383f635f603c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77e9dd9a950440c0afa35cec37a99db9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:16.288834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 812/1616] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:15 2021] DELETE /identity/v3/users/77e9dd9a950440c0afa35cec37a99db9 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:16.290717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76be8f-9e8f-4e0f-8e04-6936c6cce72a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:16.291010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76be8f-9e8f-4e0f-8e04-6936c6cce72a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:16.291285 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be76be8f-9e8f-4e0f-8e04-6936c6cce72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:16.294802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 805/1617] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:16 2021] GET /identity/v3/auth/tokens => generated 3462 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:16.332385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-be76be8f-9e8f-4e0f-8e04-6936c6cce72a None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:16.333482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-be76be8f-9e8f-4e0f-8e04-6936c6cce72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:16.467350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 813/1618] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:16.578290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:16.579545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:16.719203 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09353d3c-9369-42ff-876e-54acf862f78c service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:16.816127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f53d7-99e3-4956-a8a3-25a1c3b4aed5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:16.817618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f53d7-99e3-4956-a8a3-25a1c3b4aed5 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:16.818109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f53d7-99e3-4956-a8a3-25a1c3b4aed5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:16.818556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f53d7-99e3-4956-a8a3-25a1c3b4aed5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:16.844981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f53d7-99e3-4956-a8a3-25a1c3b4aed5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:16.846853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f53d7-99e3-4956-a8a3-25a1c3b4aed5 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:16.867298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 806/1619] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:18.102470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0337-5550-4d64-93f8-a2c77e5eecbf None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:18.102470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0337-5550-4d64-93f8-a2c77e5eecbf None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:18.102470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc0337-5550-4d64-93f8-a2c77e5eecbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:18.180406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4bcc0337-5550-4d64-93f8-a2c77e5eecbf None None] MFA Rules not processed for user `ff1374f1e319492da48f32b53c91f3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:18.181766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4bcc0337-5550-4d64-93f8-a2c77e5eecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:18.287281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc71005-a7fa-4a7f-926b-30e9175d5b60 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:18.291083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc71005-a7fa-4a7f-926b-30e9175d5b60 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:18.291083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc71005-a7fa-4a7f-926b-30e9175d5b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:18.342343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-dcc71005-a7fa-4a7f-926b-30e9175d5b60 None None] MFA Rules not processed for user `1ac05d2fe5fa40b4a18063d0d335d9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:18.342451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 814/1620] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:18 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:18.342541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dcc71005-a7fa-4a7f-926b-30e9175d5b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:18.360511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc0337-5550-4d64-93f8-a2c77e5eecbf None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:18.362505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4bcc0337-5550-4d64-93f8-a2c77e5eecbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:18.487471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 807/1621] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:18 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:18.488539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc71005-a7fa-4a7f-926b-30e9175d5b60 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:18.491554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dcc71005-a7fa-4a7f-926b-30e9175d5b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:18.523828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc71005-a7fa-4a7f-926b-30e9175d5b60 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:18.531632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:18.532810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:18.533567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:18.534098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] PATH_INFO: `/v3/projects/abf8a871c8134a589fc3a3555dc042dc` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:18.539015 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=abf8a871c8134a589fc3a3555dc042dc)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:18.541373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:18.578464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc0337-5550-4d64-93f8-a2c77e5eecbf None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:18.612877 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70277b7b-edf0-4481-acef-9328d91d0bf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:18.613895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70277b7b-edf0-4481-acef-9328d91d0bf2 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:18.614291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70277b7b-edf0-4481-acef-9328d91d0bf2 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:18.614669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70277b7b-edf0-4481-acef-9328d91d0bf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:18.634466 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70277b7b-edf0-4481-acef-9328d91d0bf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:18.634466 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70277b7b-edf0-4481-acef-9328d91d0bf2 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:18.646383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 815/1622] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:18 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:18.652167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea1d58-08ca-4998-9716-2518fabc70d4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:18.652637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea1d58-08ca-4998-9716-2518fabc70d4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:18.653454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eea1d58-08ca-4998-9716-2518fabc70d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:18.698131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4eea1d58-08ca-4998-9716-2518fabc70d4 None None] MFA Rules not processed for user `1ac05d2fe5fa40b4a18063d0d335d9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:18.707544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4eea1d58-08ca-4998-9716-2518fabc70d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:18.707982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abf8a871c8134a589fc3a3555dc042dc', 'request_id': 'req-43071d99-38a5-43bd-a799-97ae3d29e50d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:18.728494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abf8a871c8134a589fc3a3555dc042dc', 'request_id': 'req-43071d99-38a5-43bd-a799-97ae3d29e50d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:18.761997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abf8a871c8134a589fc3a3555dc042dc', 'request_id': 'req-43071d99-38a5-43bd-a799-97ae3d29e50d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:18.829653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 816/1623] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:18 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:18.844826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea1d58-08ca-4998-9716-2518fabc70d4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:18.846449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4eea1d58-08ca-4998-9716-2518fabc70d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:18.898229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] The token cache is being invalidate because project abf8a871c8134a589fc3a3555dc042dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:18.899459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:18.900280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:18.902538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 808/1624] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:18 2021] DELETE /identity/v3/projects/abf8a871c8134a589fc3a3555dc042dc => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:18.906472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:18.908342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:18.952773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eea1d58-08ca-4998-9716-2518fabc70d4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:18.958539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c86a9-ea7c-40f1-bd7d-8a9ab149d137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:18.959263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c86a9-ea7c-40f1-bd7d-8a9ab149d137 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:18.959644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c86a9-ea7c-40f1-bd7d-8a9ab149d137 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:18.960005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c86a9-ea7c-40f1-bd7d-8a9ab149d137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:18.962641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-049c86a9-ea7c-40f1-bd7d-8a9ab149d137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:18.973272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c86a9-ea7c-40f1-bd7d-8a9ab149d137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:18.974955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c86a9-ea7c-40f1-bd7d-8a9ab149d137 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:18.978681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43071d99-38a5-43bd-a799-97ae3d29e50d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:18.983630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:18.984521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:18.984797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:18.985749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] PATH_INFO: `/v3/users/d5e0532a6c81469781c73d32c4df2b2d` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:18.989057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5e0532a6c81469781c73d32c4df2b2d)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:18.989057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:18.990070 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 817/1625] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:18 2021] GET /identity/v3/auth/tokens => generated 3413 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:19.194406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5e0532a6c81469781c73d32c4df2b2d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:19.209671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5e0532a6c81469781c73d32c4df2b2d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:19.218955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5e0532a6c81469781c73d32c4df2b2d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:19.220259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5e0532a6c81469781c73d32c4df2b2d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:19.290285 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fe8d8c44-7b9f-4397-835d-e52fd16ad7d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5e0532a6c81469781c73d32c4df2b2d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:19.309073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 809/1626] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:18 2021] DELETE /identity/v3/users/d5e0532a6c81469781c73d32c4df2b2d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:19.760040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95967e99-261f-441c-b912-ff7ab521b8fb None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:19.760040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95967e99-261f-441c-b912-ff7ab521b8fb None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:19.760040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95967e99-261f-441c-b912-ff7ab521b8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:19.762332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb5e09-0642-4e72-89ce-f4341d7ccd75 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:19.762332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb5e09-0642-4e72-89ce-f4341d7ccd75 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:19.762332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becb5e09-0642-4e72-89ce-f4341d7ccd75 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:19.762332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 810/1627] 10.222.0.32 () {54 vars in 912 bytes} [Wed Oct 27 01:19:19 2021] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:19:19.762332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f496eba-2a13-4bb3-bbc0-b7893d31ec3b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:19.762332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f496eba-2a13-4bb3-bbc0-b7893d31ec3b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:19.763055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f496eba-2a13-4bb3-bbc0-b7893d31ec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:19.809306 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8f496eba-2a13-4bb3-bbc0-b7893d31ec3b None None] MFA Rules not processed for user `66c74b04afed4aabbdbee054438a4933`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:19.811698 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8f496eba-2a13-4bb3-bbc0-b7893d31ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:19.816774 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-95967e99-261f-441c-b912-ff7ab521b8fb None None] MFA Rules not processed for user `e97b78644a8046da928880c62b18253d`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:19.818265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-95967e99-261f-441c-b912-ff7ab521b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:19.965225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 818/1628] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:19 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:19.969458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 811/1629] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:19:19 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:20.010392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95967e99-261f-441c-b912-ff7ab521b8fb None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:20.015509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-95967e99-261f-441c-b912-ff7ab521b8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:20.018595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f496eba-2a13-4bb3-bbc0-b7893d31ec3b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:20.020194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8f496eba-2a13-4bb3-bbc0-b7893d31ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:20.045545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95967e99-261f-441c-b912-ff7ab521b8fb None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:20.055728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25f454-55cf-4e44-8368-6707d3988440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:20.056393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25f454-55cf-4e44-8368-6707d3988440 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:20.056666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25f454-55cf-4e44-8368-6707d3988440 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:20.056931 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25f454-55cf-4e44-8368-6707d3988440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:20.076537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25f454-55cf-4e44-8368-6707d3988440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:20.077713 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25f454-55cf-4e44-8368-6707d3988440 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:20.094586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 819/1630] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:20 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:20.126656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f496eba-2a13-4bb3-bbc0-b7893d31ec3b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:20.135112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9055c5-88ad-4caa-b438-afa5a9d80950 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:20.139316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9055c5-88ad-4caa-b438-afa5a9d80950 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:20.139316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9055c5-88ad-4caa-b438-afa5a9d80950 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:20.139316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9055c5-88ad-4caa-b438-afa5a9d80950 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:20.147337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9055c5-88ad-4caa-b438-afa5a9d80950 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:20.149324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9055c5-88ad-4caa-b438-afa5a9d80950 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:20.170239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 812/1631] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:20 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:20.373591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25f454-55cf-4e44-8368-6707d3988440 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:20.375364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8a25f454-55cf-4e44-8368-6707d3988440 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:20.516368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25f454-55cf-4e44-8368-6707d3988440 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:20.522762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:20.524601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:20.525320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:20.525668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] PATH_INFO: `/v3/projects/724e00c864484e3db38a04985ed892bf` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:20.527896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=724e00c864484e3db38a04985ed892bf)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:20.531538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:20.662565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '724e00c864484e3db38a04985ed892bf', 'request_id': 'req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:20.670768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '724e00c864484e3db38a04985ed892bf', 'request_id': 'req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:20.678331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '724e00c864484e3db38a04985ed892bf', 'request_id': 'req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:20.962315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] The token cache is being invalidate because project 724e00c864484e3db38a04985ed892bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:20.962894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:20.965764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1db16bc8-1e7e-43d8-8b8e-eadbb73f1f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:20.970856 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 820/1632] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:20 2021] DELETE /identity/v3/projects/724e00c864484e3db38a04985ed892bf => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:20.980522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c2eb-b29f-4ea0-9867-3bfda9da45f8 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:20.980522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c2eb-b29f-4ea0-9867-3bfda9da45f8 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:20.980522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c78c2eb-b29f-4ea0-9867-3bfda9da45f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:21.022799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1c78c2eb-b29f-4ea0-9867-3bfda9da45f8 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:21.051830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1c78c2eb-b29f-4ea0-9867-3bfda9da45f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:21.227682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73642-5d23-49bf-97d7-0ef6b014444f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:21.228277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73642-5d23-49bf-97d7-0ef6b014444f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:21.228749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c73642-5d23-49bf-97d7-0ef6b014444f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:21.231090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 813/1633] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:21.247636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8d40-4cd1-4031-86fb-c42b2f2c7b70 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:21.254300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8d40-4cd1-4031-86fb-c42b2f2c7b70 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:21.254848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705c8d40-4cd1-4031-86fb-c42b2f2c7b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:21.264201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-54c73642-5d23-49bf-97d7-0ef6b014444f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:21.267899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-54c73642-5d23-49bf-97d7-0ef6b014444f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:21.287611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 821/1634] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:21 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:21.288427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-705c8d40-4cd1-4031-86fb-c42b2f2c7b70 None None] MFA Rules not processed for user `1ac05d2fe5fa40b4a18063d0d335d9e2`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:21.290062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c73642-5d23-49bf-97d7-0ef6b014444f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:21.291441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-705c8d40-4cd1-4031-86fb-c42b2f2c7b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:21.306425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c73642-5d23-49bf-97d7-0ef6b014444f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:21.312835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb53f-6556-4968-ad31-8aa060f16039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:21.313562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb53f-6556-4968-ad31-8aa060f16039 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:21.314129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb53f-6556-4968-ad31-8aa060f16039 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:21.314129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dafb53f-6556-4968-ad31-8aa060f16039 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:21.314895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafb53f-6556-4968-ad31-8aa060f16039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:21.315244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafb53f-6556-4968-ad31-8aa060f16039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:21.316965 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dafb53f-6556-4968-ad31-8aa060f16039 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:21.337633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 822/1635] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:21 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:21.343270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb53f-6556-4968-ad31-8aa060f16039 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:21.356402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dafb53f-6556-4968-ad31-8aa060f16039 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:21.363478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfd42-19ee-48fa-8cd6-0e66187f7a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:21.363812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd42-19ee-48fa-8cd6-0e66187f7a2b admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:21.364187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd42-19ee-48fa-8cd6-0e66187f7a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:21.364557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd42-19ee-48fa-8cd6-0e66187f7a2b admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:21.365409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcfd42-19ee-48fa-8cd6-0e66187f7a2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:21.369526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bcfd42-19ee-48fa-8cd6-0e66187f7a2b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:21.410758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 814/1636] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:21 2021] POST /identity/v3/auth/tokens => generated 3413 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:21.497308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 823/1637] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:21 2021] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:21.497666 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c8d40-4cd1-4031-86fb-c42b2f2c7b70 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:21.533415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705c8d40-4cd1-4031-86fb-c42b2f2c7b70 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:21.678954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4503e91-1fe2-480f-bd9e-fc4f660aa667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:21.683276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4503e91-1fe2-480f-bd9e-fc4f660aa667 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:21.683638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4503e91-1fe2-480f-bd9e-fc4f660aa667 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:21.684302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4503e91-1fe2-480f-bd9e-fc4f660aa667 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:21.685191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4503e91-1fe2-480f-bd9e-fc4f660aa667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:21.687521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4503e91-1fe2-480f-bd9e-fc4f660aa667 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:21.830187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 815/1638] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:21 2021] POST /identity/v3/users => generated 283 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:21.832115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfd42-19ee-48fa-8cd6-0e66187f7a2b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:21.847435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfd42-19ee-48fa-8cd6-0e66187f7a2b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:21.859110 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63969-31b1-426f-869a-e2e2815aab8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:21.859879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63969-31b1-426f-869a-e2e2815aab8c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:21.860850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63969-31b1-426f-869a-e2e2815aab8c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:21.860850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e63969-31b1-426f-869a-e2e2815aab8c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:21.861411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63969-31b1-426f-869a-e2e2815aab8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:21.866427 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e63969-31b1-426f-869a-e2e2815aab8c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:21.889636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4503e91-1fe2-480f-bd9e-fc4f660aa667 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:21.902626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 824/1639] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:21 2021] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:21.911508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4503e91-1fe2-480f-bd9e-fc4f660aa667 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:21.921628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b6651-cb9f-415d-b9b4-038c65b89f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:21.922636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6651-cb9f-415d-b9b4-038c65b89f87 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:21.931331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6651-cb9f-415d-b9b4-038c65b89f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:21.932071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b6651-cb9f-415d-b9b4-038c65b89f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:21.933231 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b6651-cb9f-415d-b9b4-038c65b89f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:21.936093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b6651-cb9f-415d-b9b4-038c65b89f87 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:21.951614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 816/1640] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:21 2021] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:21.955432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63969-31b1-426f-869a-e2e2815aab8c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:21.984172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e63969-31b1-426f-869a-e2e2815aab8c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:21.993162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63ef2e-51df-4a12-9595-7f4f7db40132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:21.996171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63ef2e-51df-4a12-9595-7f4f7db40132 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:21.997038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63ef2e-51df-4a12-9595-7f4f7db40132 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:21.997459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b63ef2e-51df-4a12-9595-7f4f7db40132 admin admin] PATH_INFO: `/v3/projects/ad80925280684b00acc04c1eac72f03f/users/86f81468bbf247a8a1fd581ddbd0e54a/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:22.057364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63ef2e-51df-4a12-9595-7f4f7db40132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad80925280684b00acc04c1eac72f03f, user_id=86f81468bbf247a8a1fd581ddbd0e54a, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:22.060385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b63ef2e-51df-4a12-9595-7f4f7db40132 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:22.157126 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 825/1641] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:21 2021] PUT /identity/v3/projects/ad80925280684b00acc04c1eac72f03f/users/86f81468bbf247a8a1fd581ddbd0e54a/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:22.169249 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae353cc8-26de-457f-b845-5f4a3a742f9d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:22.169889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae353cc8-26de-457f-b845-5f4a3a742f9d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:22.170434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae353cc8-26de-457f-b845-5f4a3a742f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:22.292445 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ae353cc8-26de-457f-b845-5f4a3a742f9d None None] MFA Rules not processed for user `86f81468bbf247a8a1fd581ddbd0e54a`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:22.295962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ae353cc8-26de-457f-b845-5f4a3a742f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:22.534448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 817/1642] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:22 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:22.538464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63ef2e-51df-4a12-9595-7f4f7db40132 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:22.736683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b63ef2e-51df-4a12-9595-7f4f7db40132 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:22.744477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904a300-512f-422f-a962-8e00743e043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:22.745575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904a300-512f-422f-a962-8e00743e043f admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:22.746086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904a300-512f-422f-a962-8e00743e043f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:22.746547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2904a300-512f-422f-a962-8e00743e043f admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:22.747445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904a300-512f-422f-a962-8e00743e043f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:22.750330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2904a300-512f-422f-a962-8e00743e043f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:22.924765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 826/1643] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:22 2021] POST /identity/v3/projects => generated 363 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:22.926213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae353cc8-26de-457f-b845-5f4a3a742f9d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:22.943018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae353cc8-26de-457f-b845-5f4a3a742f9d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:23.089151 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e4184-692d-4abb-90fc-bf7f2ea7b45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:23.090680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4184-692d-4abb-90fc-bf7f2ea7b45f admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:23.091299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4184-692d-4abb-90fc-bf7f2ea7b45f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:23.091719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e4184-692d-4abb-90fc-bf7f2ea7b45f admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:23.092562 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e4184-692d-4abb-90fc-bf7f2ea7b45f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:23.094766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e4184-692d-4abb-90fc-bf7f2ea7b45f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:23.200544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 818/1644] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:22 2021] POST /identity/v3/users => generated 288 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:23.206758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904a300-512f-422f-a962-8e00743e043f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:23.222551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2904a300-512f-422f-a962-8e00743e043f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:23.239613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852e4283-ea23-49ac-b0d3-0c90e1f54983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:23.241249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e4283-ea23-49ac-b0d3-0c90e1f54983 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:23.241535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e4283-ea23-49ac-b0d3-0c90e1f54983 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:23.243099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852e4283-ea23-49ac-b0d3-0c90e1f54983 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:23.244588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e4283-ea23-49ac-b0d3-0c90e1f54983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:23.247437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852e4283-ea23-49ac-b0d3-0c90e1f54983 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:23.274234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 827/1645] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:23 2021] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:23.278685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e4184-692d-4abb-90fc-bf7f2ea7b45f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:23.291076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e4184-692d-4abb-90fc-bf7f2ea7b45f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:23.296690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588f33c-ff37-425e-9a7f-9a0814f7f993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:23.297599 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588f33c-ff37-425e-9a7f-9a0814f7f993 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:23.297873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588f33c-ff37-425e-9a7f-9a0814f7f993 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:23.298176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0588f33c-ff37-425e-9a7f-9a0814f7f993 admin admin] PATH_INFO: `/v3/projects/66e46ab353074fdd8993e399dc7bb91a/users/ddf341476f944d05902bf55ea97cf6d9/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:23.360284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588f33c-ff37-425e-9a7f-9a0814f7f993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e46ab353074fdd8993e399dc7bb91a, user_id=ddf341476f944d05902bf55ea97cf6d9, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:23.391604 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0588f33c-ff37-425e-9a7f-9a0814f7f993 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:23.410291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67e16d-1817-4a64-866d-64738d3ac081 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:23.410812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67e16d-1817-4a64-866d-64738d3ac081 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:23.411284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67e16d-1817-4a64-866d-64738d3ac081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:23.441587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4b67e16d-1817-4a64-866d-64738d3ac081 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:23.446355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4b67e16d-1817-4a64-866d-64738d3ac081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:23.487463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 819/1646] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:23 2021] PUT /identity/v3/projects/66e46ab353074fdd8993e399dc7bb91a/users/ddf341476f944d05902bf55ea97cf6d9/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:23.491292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588f33c-ff37-425e-9a7f-9a0814f7f993 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:23.553644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 828/1647] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:19:23 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:23.678166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0588f33c-ff37-425e-9a7f-9a0814f7f993 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:23.689750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ffc72-b1c9-4da7-922b-48256d4f7938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:23.693511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ffc72-b1c9-4da7-922b-48256d4f7938 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:23.699181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ffc72-b1c9-4da7-922b-48256d4f7938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:23.699181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ffc72-b1c9-4da7-922b-48256d4f7938 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:23.700057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ffc72-b1c9-4da7-922b-48256d4f7938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:23.703969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ffc72-b1c9-4da7-922b-48256d4f7938 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:23.737300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67e16d-1817-4a64-866d-64738d3ac081 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:23.740479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 820/1648] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:23 2021] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:23.758649 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67e16d-1817-4a64-866d-64738d3ac081 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:23.770018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17485ee5-b128-4b90-bf46-73f92d164f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:23.770975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17485ee5-b128-4b90-bf46-73f92d164f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:23.771218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17485ee5-b128-4b90-bf46-73f92d164f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:23.772370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17485ee5-b128-4b90-bf46-73f92d164f8b admin admin] PATH_INFO: `/v3/projects/66e46ab353074fdd8993e399dc7bb91a/users/ddf341476f944d05902bf55ea97cf6d9/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:23.780325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17485ee5-b128-4b90-bf46-73f92d164f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=66e46ab353074fdd8993e399dc7bb91a, user_id=ddf341476f944d05902bf55ea97cf6d9, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:23.791051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17485ee5-b128-4b90-bf46-73f92d164f8b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:23.819704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 829/1649] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:23 2021] PUT /identity/v3/projects/66e46ab353074fdd8993e399dc7bb91a/users/ddf341476f944d05902bf55ea97cf6d9/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:23.831894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb053c-ff45-4c26-8e14-04a56146b4fc None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:23.832196 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb053c-ff45-4c26-8e14-04a56146b4fc None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:23.832668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffb053c-ff45-4c26-8e14-04a56146b4fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:23.871742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-5ffb053c-ff45-4c26-8e14-04a56146b4fc None None] MFA Rules not processed for user `ddf341476f944d05902bf55ea97cf6d9`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:23.885320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5ffb053c-ff45-4c26-8e14-04a56146b4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:24.075466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 821/1650] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:23 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:24.087895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17485ee5-b128-4b90-bf46-73f92d164f8b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:24.090300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-17485ee5-b128-4b90-bf46-73f92d164f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:24.197749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17485ee5-b128-4b90-bf46-73f92d164f8b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:24.204513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56364c69-efa5-4292-8436-1b616e28b32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:24.206220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56364c69-efa5-4292-8436-1b616e28b32a service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:24.206666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56364c69-efa5-4292-8436-1b616e28b32a service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:24.207195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56364c69-efa5-4292-8436-1b616e28b32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:24.230642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56364c69-efa5-4292-8436-1b616e28b32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:24.232506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56364c69-efa5-4292-8436-1b616e28b32a service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:24.250072 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 830/1651] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:24 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:24.341970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb053c-ff45-4c26-8e14-04a56146b4fc None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:24.344170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5ffb053c-ff45-4c26-8e14-04a56146b4fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:24.483263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffb053c-ff45-4c26-8e14-04a56146b4fc None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:24.494791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0e0a4-c2ad-43e5-a2d4-e26e3bbbb4db service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:24.495924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0e0a4-c2ad-43e5-a2d4-e26e3bbbb4db service swift] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:24.496961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0e0a4-c2ad-43e5-a2d4-e26e3bbbb4db service swift] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:24.497734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0e0a4-c2ad-43e5-a2d4-e26e3bbbb4db service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:24.552467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56364c69-efa5-4292-8436-1b616e28b32a service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:24.562179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56364c69-efa5-4292-8436-1b616e28b32a service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:24.570813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63a9f6-ca81-4b6a-b2a9-f06bf1f60446 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:24.571455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a9f6-ca81-4b6a-b2a9-f06bf1f60446 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:24.572537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a9f6-ca81-4b6a-b2a9-f06bf1f60446 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:24.573743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63a9f6-ca81-4b6a-b2a9-f06bf1f60446 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:24.641507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0e0a4-c2ad-43e5-a2d4-e26e3bbbb4db service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:24.643565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0e0a4-c2ad-43e5-a2d4-e26e3bbbb4db service swift] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:24.655264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 822/1652] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:19:24 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:19:24.713218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63a9f6-ca81-4b6a-b2a9-f06bf1f60446 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:24.715750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63a9f6-ca81-4b6a-b2a9-f06bf1f60446 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:24.725892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 831/1653] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:24 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:25.330949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254ca72-857c-4e25-821d-5ba7e9072e71 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:25.331212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254ca72-857c-4e25-821d-5ba7e9072e71 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:25.331511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254ca72-857c-4e25-821d-5ba7e9072e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:25.441852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0254ca72-857c-4e25-821d-5ba7e9072e71 None None] MFA Rules not processed for user `ff1374f1e319492da48f32b53c91f3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:25.443095 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0254ca72-857c-4e25-821d-5ba7e9072e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:25.577518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 823/1654] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:25 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:26.469118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70244c6a-0754-49a2-b66d-a170d6b9202c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:26.475355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70244c6a-0754-49a2-b66d-a170d6b9202c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:26.475961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70244c6a-0754-49a2-b66d-a170d6b9202c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:26.516713 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-70244c6a-0754-49a2-b66d-a170d6b9202c None None] MFA Rules not processed for user `e97b78644a8046da928880c62b18253d`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:26.518384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-70244c6a-0754-49a2-b66d-a170d6b9202c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:26.642740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 832/1655] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:26 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:30.876613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254ca72-857c-4e25-821d-5ba7e9072e71 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:30.878316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0254ca72-857c-4e25-821d-5ba7e9072e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:30.962469 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0254ca72-857c-4e25-821d-5ba7e9072e71 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:30.980059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:30.980919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:30.981200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:30.981471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] PATH_INFO: `/v3/users/b1463a297bac4309bf7868a8176fca08` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:30.983703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1463a297bac4309bf7868a8176fca08)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:30.986014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:31.385996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1463a297bac4309bf7868a8176fca08'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:31.411218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1463a297bac4309bf7868a8176fca08'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:31.419753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1463a297bac4309bf7868a8176fca08'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:31.424568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1463a297bac4309bf7868a8176fca08'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:31.526361 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1463a297bac4309bf7868a8176fca08'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:31.545054 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 824/1656] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:30 2021] DELETE /identity/v3/users/b1463a297bac4309bf7868a8176fca08 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:31.588178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883402-751d-4f12-9aea-356d19336d63 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:31.589038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883402-751d-4f12-9aea-356d19336d63 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:31.589464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0883402-751d-4f12-9aea-356d19336d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:31.616753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f0883402-751d-4f12-9aea-356d19336d63 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:31.618835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f0883402-751d-4f12-9aea-356d19336d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:31.745779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 833/1657] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:31.748472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:31.748472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:31.822276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883402-751d-4f12-9aea-356d19336d63 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:31.825216 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f0883402-751d-4f12-9aea-356d19336d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:31.847575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0883402-751d-4f12-9aea-356d19336d63 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:31.853865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:31.854898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:31.855269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:31.855779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] PATH_INFO: `/v3/users/86f81468bbf247a8a1fd581ddbd0e54a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:31.857219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f81468bbf247a8a1fd581ddbd0e54a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:31.863943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68929817-3815-4d35-9383-23c57e53c135 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:31.872828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09415d-4c38-405e-89a4-24b1de52e3db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:31.875764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09415d-4c38-405e-89a4-24b1de52e3db service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:31.875764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09415d-4c38-405e-89a4-24b1de52e3db service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:31.875764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f09415d-4c38-405e-89a4-24b1de52e3db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:31.876831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:31.903376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09415d-4c38-405e-89a4-24b1de52e3db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:31.904898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f09415d-4c38-405e-89a4-24b1de52e3db service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:31.916872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 825/1658] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:32.296498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f81468bbf247a8a1fd581ddbd0e54a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:32.309322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f81468bbf247a8a1fd581ddbd0e54a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:32.317055 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f81468bbf247a8a1fd581ddbd0e54a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:32.494993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f81468bbf247a8a1fd581ddbd0e54a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:32.495385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb3b166f-75a4-4253-b44c-faa3d8d0157f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f81468bbf247a8a1fd581ddbd0e54a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:32.503272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09415d-4c38-405e-89a4-24b1de52e3db service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:32.504800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 834/1659] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:31 2021] DELETE /identity/v3/users/86f81468bbf247a8a1fd581ddbd0e54a => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:32.505444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1f09415d-4c38-405e-89a4-24b1de52e3db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:32.509706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352be4e-362c-4e95-9c70-c0803d288202 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:32.510197 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352be4e-362c-4e95-9c70-c0803d288202 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:32.510742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352be4e-362c-4e95-9c70-c0803d288202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:32.529460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f09415d-4c38-405e-89a4-24b1de52e3db service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:32.542593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8352be4e-362c-4e95-9c70-c0803d288202 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:32.543898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8352be4e-362c-4e95-9c70-c0803d288202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:32.612176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:32.613322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:32.613609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:32.614119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] PATH_INFO: `/v3/projects/08338b7cd30a4c0fa7c07ecb1bd65bcc` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:32.615462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08338b7cd30a4c0fa7c07ecb1bd65bcc)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:32.618352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:32.628375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 835/1660] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:32.641051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352be4e-362c-4e95-9c70-c0803d288202 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:32.642959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8352be4e-362c-4e95-9c70-c0803d288202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:32.711591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352be4e-362c-4e95-9c70-c0803d288202 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:32.716927 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eddee17-62c3-40fe-9628-fa498cde060d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:32.717476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddee17-62c3-40fe-9628-fa498cde060d service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:32.717757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddee17-62c3-40fe-9628-fa498cde060d service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:32.718379 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddee17-62c3-40fe-9628-fa498cde060d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:32.750670 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddee17-62c3-40fe-9628-fa498cde060d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:32.756230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eddee17-62c3-40fe-9628-fa498cde060d service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:32.775983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08338b7cd30a4c0fa7c07ecb1bd65bcc', 'request_id': 'req-d0f7016e-e041-46b6-995c-e59636906cf9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:32.777860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 836/1661] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:32.792518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08338b7cd30a4c0fa7c07ecb1bd65bcc', 'request_id': 'req-d0f7016e-e041-46b6-995c-e59636906cf9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:32.804629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08338b7cd30a4c0fa7c07ecb1bd65bcc', 'request_id': 'req-d0f7016e-e041-46b6-995c-e59636906cf9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:33.226897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] The token cache is being invalidate because project 08338b7cd30a4c0fa7c07ecb1bd65bcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:33.227621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:33.228219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d0f7016e-e041-46b6-995c-e59636906cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:33.235098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 826/1662] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:32 2021] DELETE /identity/v3/projects/08338b7cd30a4c0fa7c07ecb1bd65bcc => generated 0 bytes in 729 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:33.237549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ded5a-ecc2-4988-86b8-481233b9abb6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:33.237830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ded5a-ecc2-4988-86b8-481233b9abb6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:33.238163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ded5a-ecc2-4988-86b8-481233b9abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:33.259493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-067ded5a-ecc2-4988-86b8-481233b9abb6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:33.260946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-067ded5a-ecc2-4988-86b8-481233b9abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:33.360227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 837/1663] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:33.368341 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441bd14-886c-446a-a541-6032e9a26207 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:33.369149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441bd14-886c-446a-a541-6032e9a26207 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:33.369149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f441bd14-886c-446a-a541-6032e9a26207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:33.392046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f441bd14-886c-446a-a541-6032e9a26207 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:33.393276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f441bd14-886c-446a-a541-6032e9a26207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:33.402052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 827/1664] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:33.406565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ded5a-ecc2-4988-86b8-481233b9abb6 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:33.418972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ded5a-ecc2-4988-86b8-481233b9abb6 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:33.423708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:33.424412 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:33.424683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:33.424958 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:33.425849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:33.426268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:33.428040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:33.452556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 838/1665] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:33 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:33.456756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441bd14-886c-446a-a541-6032e9a26207 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:33.468423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f441bd14-886c-446a-a541-6032e9a26207 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:33.478152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afa0fb-0390-4fc7-b68e-8a047759e2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:33.478152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa0fb-0390-4fc7-b68e-8a047759e2ca admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:33.478152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa0fb-0390-4fc7-b68e-8a047759e2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:33.478152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afa0fb-0390-4fc7-b68e-8a047759e2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:33.478593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afa0fb-0390-4fc7-b68e-8a047759e2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:33.478593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afa0fb-0390-4fc7-b68e-8a047759e2ca admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:33.662766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:33.662766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:33.679839 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bed627-7b6b-49e9-82fc-fd726d7adb8e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:33.684602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:33.685703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:33.686337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:33.686954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] PATH_INFO: `/v3/projects/ad80925280684b00acc04c1eac72f03f` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:33.688850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad80925280684b00acc04c1eac72f03f)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:33.691066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:33.702911 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 828/1666] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:33 2021] POST /identity/v3/projects => generated 405 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:33.707748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afa0fb-0390-4fc7-b68e-8a047759e2ca admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:33.776975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad80925280684b00acc04c1eac72f03f', 'request_id': 'req-531546e3-c53c-4c2e-868e-c632aec93d02'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:33.778623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afa0fb-0390-4fc7-b68e-8a047759e2ca admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:33.783995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad80925280684b00acc04c1eac72f03f', 'request_id': 'req-531546e3-c53c-4c2e-868e-c632aec93d02'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:33.801678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad80925280684b00acc04c1eac72f03f', 'request_id': 'req-531546e3-c53c-4c2e-868e-c632aec93d02'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:33.863399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89ed15-7590-4c7f-95a5-e5555999aa61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:33.864217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89ed15-7590-4c7f-95a5-e5555999aa61 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:33.864521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89ed15-7590-4c7f-95a5-e5555999aa61 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:33.864837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c89ed15-7590-4c7f-95a5-e5555999aa61 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:33.865733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89ed15-7590-4c7f-95a5-e5555999aa61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:33.868733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c89ed15-7590-4c7f-95a5-e5555999aa61 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:33.951632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] The token cache is being invalidate because project ad80925280684b00acc04c1eac72f03f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:34.005531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:34.005531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:34.005531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 839/1667] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:33 2021] DELETE /identity/v3/projects/ad80925280684b00acc04c1eac72f03f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:34.005531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:34.005531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:34.017385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531546e3-c53c-4c2e-868e-c632aec93d02 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:34.022439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:34.023604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:34.023871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:34.024142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] PATH_INFO: `/v3/users/ddf341476f944d05902bf55ea97cf6d9` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:34.025451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf341476f944d05902bf55ea97cf6d9)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:34.027406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:34.180791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 829/1668] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:33 2021] POST /identity/v3/users => generated 303 bytes in 474 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:34.188480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89ed15-7590-4c7f-95a5-e5555999aa61 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:34.191398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0c89ed15-7590-4c7f-95a5-e5555999aa61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:34.208118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c89ed15-7590-4c7f-95a5-e5555999aa61 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:34.215167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d99602-82f3-4906-b73b-3697d7343b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:34.216100 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d99602-82f3-4906-b73b-3697d7343b50 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:34.216385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d99602-82f3-4906-b73b-3697d7343b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:34.216680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d99602-82f3-4906-b73b-3697d7343b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:34.218004 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d99602-82f3-4906-b73b-3697d7343b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:34.219137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d99602-82f3-4906-b73b-3697d7343b50 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:34.269552 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 830/1669] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:34 2021] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:34.273421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d99602-82f3-4906-b73b-3697d7343b50 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:34.283855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d99602-82f3-4906-b73b-3697d7343b50 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:34.289786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc83f14-9007-438f-b09b-99454292e3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:34.290484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc83f14-9007-438f-b09b-99454292e3ac admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:34.290764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc83f14-9007-438f-b09b-99454292e3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:34.291092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc83f14-9007-438f-b09b-99454292e3ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:34.291906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc83f14-9007-438f-b09b-99454292e3ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:34.293572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc83f14-9007-438f-b09b-99454292e3ac admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:34.306621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 831/1670] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:34 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:34.310723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc83f14-9007-438f-b09b-99454292e3ac admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:34.321841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc83f14-9007-438f-b09b-99454292e3ac admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:34.326758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31f5e1b-01a0-45e1-9d7a-4f8d4b166b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:34.327639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f5e1b-01a0-45e1-9d7a-4f8d4b166b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:34.327937 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f5e1b-01a0-45e1-9d7a-4f8d4b166b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:34.328230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31f5e1b-01a0-45e1-9d7a-4f8d4b166b4e admin admin] PATH_INFO: `/v3/projects/2f905f4273f443a59c1103b161c52e13/users/4ee4f926ec8b4a39bac39ae71214747f/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:34.364219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf341476f944d05902bf55ea97cf6d9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:34.369862 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f5e1b-01a0-45e1-9d7a-4f8d4b166b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2f905f4273f443a59c1103b161c52e13, user_id=4ee4f926ec8b4a39bac39ae71214747f, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:34.373303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31f5e1b-01a0-45e1-9d7a-4f8d4b166b4e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:34.380598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf341476f944d05902bf55ea97cf6d9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:34.390916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf341476f944d05902bf55ea97cf6d9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:34.486012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 832/1671] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:34 2021] PUT /identity/v3/projects/2f905f4273f443a59c1103b161c52e13/users/4ee4f926ec8b4a39bac39ae71214747f/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:34.496393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41563ab2-9aa2-4080-8d83-23976f619503 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:34.496815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41563ab2-9aa2-4080-8d83-23976f619503 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:34.497094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41563ab2-9aa2-4080-8d83-23976f619503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:34.500609 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf341476f944d05902bf55ea97cf6d9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:34.501224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf341476f944d05902bf55ea97cf6d9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:34.514213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 840/1672] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:34 2021] DELETE /identity/v3/users/ddf341476f944d05902bf55ea97cf6d9 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:34.553083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-41563ab2-9aa2-4080-8d83-23976f619503 None None] MFA Rules not processed for user `4ee4f926ec8b4a39bac39ae71214747f`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:34.556639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-41563ab2-9aa2-4080-8d83-23976f619503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:34.646138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 833/1673] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:34 2021] POST /identity/v3/auth/tokens => generated 3425 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:34.650934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:34.653042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:34.725324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601381e5-86f2-447a-baca-0024c871753d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:34.872869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cd819-afb9-40f1-ad13-448383d4d89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:34.872869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cd819-afb9-40f1-ad13-448383d4d89b admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:34.872869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cd819-afb9-40f1-ad13-448383d4d89b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:34.872869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cd819-afb9-40f1-ad13-448383d4d89b admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:34.873528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cd819-afb9-40f1-ad13-448383d4d89b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:34.873528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cd819-afb9-40f1-ad13-448383d4d89b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:35.045709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 841/1674] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:34 2021] POST /identity/v3/projects => generated 403 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:35.049867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41563ab2-9aa2-4080-8d83-23976f619503 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:35.062554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41563ab2-9aa2-4080-8d83-23976f619503 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:35.067629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cd819-afb9-40f1-ad13-448383d4d89b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:35.069526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-949cd819-afb9-40f1-ad13-448383d4d89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:35.127876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6101e-f4d2-4ef2-bc39-b83cafe63cbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:35.128460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6101e-f4d2-4ef2-bc39-b83cafe63cbf admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.128734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6101e-f4d2-4ef2-bc39-b83cafe63cbf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.129000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6101e-f4d2-4ef2-bc39-b83cafe63cbf admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.129694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6101e-f4d2-4ef2-bc39-b83cafe63cbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:35.132564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6101e-f4d2-4ef2-bc39-b83cafe63cbf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:35.159752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cd819-afb9-40f1-ad13-448383d4d89b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:35.167601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:35.168647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.168935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.169255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] PATH_INFO: `/v3/projects/66e46ab353074fdd8993e399dc7bb91a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.170661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66e46ab353074fdd8993e399dc7bb91a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:35.173323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:35.364310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 834/1675] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:35 2021] POST /identity/v3/users => generated 308 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:35.368431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6101e-f4d2-4ef2-bc39-b83cafe63cbf admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:35.378652 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6101e-f4d2-4ef2-bc39-b83cafe63cbf admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:35.386773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a91fa-49fb-417d-9880-0e604381dc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:35.387508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a91fa-49fb-417d-9880-0e604381dc5d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.402867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a91fa-49fb-417d-9880-0e604381dc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.403212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a91fa-49fb-417d-9880-0e604381dc5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.404016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a91fa-49fb-417d-9880-0e604381dc5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:35.407035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66e46ab353074fdd8993e399dc7bb91a', 'request_id': 'req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:35.408684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a91fa-49fb-417d-9880-0e604381dc5d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:35.420294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66e46ab353074fdd8993e399dc7bb91a', 'request_id': 'req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:35.427405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66e46ab353074fdd8993e399dc7bb91a', 'request_id': 'req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:35.435549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 835/1676] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:35 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:35.440034 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a91fa-49fb-417d-9880-0e604381dc5d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:35.453472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a91fa-49fb-417d-9880-0e604381dc5d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:35.546488 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f118284-a4f9-47b4-a5a0-683ca4e87919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:35.547675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f118284-a4f9-47b4-a5a0-683ca4e87919 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.548159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f118284-a4f9-47b4-a5a0-683ca4e87919 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.548436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f118284-a4f9-47b4-a5a0-683ca4e87919 admin admin] PATH_INFO: `/v3/projects/8c3bb059d5324fb195076d863d7d950a/users/0a7963df93db4b0c83e94d6032b2393c/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.564902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f118284-a4f9-47b4-a5a0-683ca4e87919 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3bb059d5324fb195076d863d7d950a, user_id=0a7963df93db4b0c83e94d6032b2393c, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:35.567574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f118284-a4f9-47b4-a5a0-683ca4e87919 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:35.623708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] The token cache is being invalidate because project 66e46ab353074fdd8993e399dc7bb91a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:35.628876 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:35.634930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-10b911a4-1b5b-4a09-bf23-65cd2ce2648a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:35.637161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 836/1677] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:35 2021] PUT /identity/v3/projects/8c3bb059d5324fb195076d863d7d950a/users/0a7963df93db4b0c83e94d6032b2393c/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:35.638299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f118284-a4f9-47b4-a5a0-683ca4e87919 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:35.640231 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6f118284-a4f9-47b4-a5a0-683ca4e87919 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:35.643016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 842/1678] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:35 2021] DELETE /identity/v3/projects/66e46ab353074fdd8993e399dc7bb91a => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:35.646030 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff433c-b81a-4258-ad39-28932b3160c2 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.651330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff433c-b81a-4258-ad39-28932b3160c2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.651330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff433c-b81a-4258-ad39-28932b3160c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.678935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-baff433c-b81a-4258-ad39-28932b3160c2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:35.680578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-baff433c-b81a-4258-ad39-28932b3160c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:35.734793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f118284-a4f9-47b4-a5a0-683ca4e87919 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:35.740114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7967b91-31b6-4f1b-a4c9-9f74eff036ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:35.741035 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7967b91-31b6-4f1b-a4c9-9f74eff036ac admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.742120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7967b91-31b6-4f1b-a4c9-9f74eff036ac admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.742592 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7967b91-31b6-4f1b-a4c9-9f74eff036ac admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.743488 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7967b91-31b6-4f1b-a4c9-9f74eff036ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:35.745175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7967b91-31b6-4f1b-a4c9-9f74eff036ac admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:35.753417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 843/1679] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:35.762292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 837/1680] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:35 2021] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:35.763946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f060a-a35b-4a59-baf9-059fd47473de None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.764276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f060a-a35b-4a59-baf9-059fd47473de None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.764552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f060a-a35b-4a59-baf9-059fd47473de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.766892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7967b91-31b6-4f1b-a4c9-9f74eff036ac admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:35.777521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7967b91-31b6-4f1b-a4c9-9f74eff036ac admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:35.782272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8c2521-86b2-48c3-91d1-e05d5a165ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:35.783149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c2521-86b2-48c3-91d1-e05d5a165ce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.783424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c2521-86b2-48c3-91d1-e05d5a165ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.783696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c2521-86b2-48c3-91d1-e05d5a165ce7 admin admin] PATH_INFO: `/v3/projects/8c3bb059d5324fb195076d863d7d950a/users/0a7963df93db4b0c83e94d6032b2393c/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.784789 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e35f060a-a35b-4a59-baf9-059fd47473de None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:35.785763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c2521-86b2-48c3-91d1-e05d5a165ce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c3bb059d5324fb195076d863d7d950a, user_id=0a7963df93db4b0c83e94d6032b2393c, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:35.786284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e35f060a-a35b-4a59-baf9-059fd47473de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:35.789113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8c2521-86b2-48c3-91d1-e05d5a165ce7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:35.798973 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 844/1681] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:35 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:35.803537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f060a-a35b-4a59-baf9-059fd47473de None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:35.806265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 838/1682] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:35 2021] PUT /identity/v3/projects/8c3bb059d5324fb195076d863d7d950a/users/0a7963df93db4b0c83e94d6032b2393c/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:35.818874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35f060a-a35b-4a59-baf9-059fd47473de None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:35.853390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def53097-2e57-4b48-ba53-435ca976d207 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.853733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def53097-2e57-4b48-ba53-435ca976d207 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.853942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def53097-2e57-4b48-ba53-435ca976d207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.880507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-def53097-2e57-4b48-ba53-435ca976d207 None None] MFA Rules not processed for user `0a7963df93db4b0c83e94d6032b2393c`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:35.880704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb60b4-5f11-40d5-aa44-77b99ab7790a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:35.881163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb60b4-5f11-40d5-aa44-77b99ab7790a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.881441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb60b4-5f11-40d5-aa44-77b99ab7790a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.881617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-def53097-2e57-4b48-ba53-435ca976d207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:35.881720 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb60b4-5f11-40d5-aa44-77b99ab7790a admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.882878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb60b4-5f11-40d5-aa44-77b99ab7790a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:35.883193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb60b4-5f11-40d5-aa44-77b99ab7790a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:35.884895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eb60b4-5f11-40d5-aa44-77b99ab7790a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:35.898365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 845/1683] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:35 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:19:35.902398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb60b4-5f11-40d5-aa44-77b99ab7790a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:35.914276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb60b4-5f11-40d5-aa44-77b99ab7790a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:35.920894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddcd4f-d59f-4e5c-b93c-451dc2cadb72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:35.921571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddcd4f-d59f-4e5c-b93c-451dc2cadb72 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:35.921850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddcd4f-d59f-4e5c-b93c-451dc2cadb72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:35.922160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dddcd4f-d59f-4e5c-b93c-451dc2cadb72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:35.922873 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddcd4f-d59f-4e5c-b93c-451dc2cadb72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:35.926222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dddcd4f-d59f-4e5c-b93c-451dc2cadb72 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:35.964283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 839/1684] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:35 2021] POST /identity/v3/auth/tokens => generated 3490 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:35.976800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def53097-2e57-4b48-ba53-435ca976d207 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:35.978299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-def53097-2e57-4b48-ba53-435ca976d207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:36.010687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 846/1685] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:35 2021] POST /identity/v3/projects => generated 367 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:36.015060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddcd4f-d59f-4e5c-b93c-451dc2cadb72 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:36.050781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def53097-2e57-4b48-ba53-435ca976d207 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:36.077842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dddcd4f-d59f-4e5c-b93c-451dc2cadb72 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:36.083339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3647f8-6aaa-4504-9dd7-52deb926cea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:36.084408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3647f8-6aaa-4504-9dd7-52deb926cea0 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.084408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3647f8-6aaa-4504-9dd7-52deb926cea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.084752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3647f8-6aaa-4504-9dd7-52deb926cea0 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.086217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3647f8-6aaa-4504-9dd7-52deb926cea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:36.088284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3647f8-6aaa-4504-9dd7-52deb926cea0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:36.107900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add021f-7df7-47bc-84c2-9d4571b298ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:36.110339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add021f-7df7-47bc-84c2-9d4571b298ac service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.110339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add021f-7df7-47bc-84c2-9d4571b298ac service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.110339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add021f-7df7-47bc-84c2-9d4571b298ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.177021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add021f-7df7-47bc-84c2-9d4571b298ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:36.178503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add021f-7df7-47bc-84c2-9d4571b298ac service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:36.188822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 840/1686] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:35 2021] GET /identity/v3/auth/tokens => generated 3490 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:36.205738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 847/1687] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:36 2021] POST /identity/v3/users => generated 284 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:36.215588 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add021f-7df7-47bc-84c2-9d4571b298ac service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:36.227714 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add021f-7df7-47bc-84c2-9d4571b298ac service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:36.239019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f0e27-681a-449a-a49e-8837b47f20c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:36.239720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f0e27-681a-449a-a49e-8837b47f20c9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.239972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f0e27-681a-449a-a49e-8837b47f20c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.240239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1f0e27-681a-449a-a49e-8837b47f20c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.240981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f0e27-681a-449a-a49e-8837b47f20c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:36.242964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1f0e27-681a-449a-a49e-8837b47f20c9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:36.254594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 841/1688] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:36 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:36.259300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3647f8-6aaa-4504-9dd7-52deb926cea0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:36.270593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3647f8-6aaa-4504-9dd7-52deb926cea0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:36.276690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb8fd7-668d-4342-af97-00e8f67e4eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:36.277460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8fd7-668d-4342-af97-00e8f67e4eaa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.278082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8fd7-668d-4342-af97-00e8f67e4eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.278421 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb8fd7-668d-4342-af97-00e8f67e4eaa admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.279645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb8fd7-668d-4342-af97-00e8f67e4eaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:36.285164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb8fd7-668d-4342-af97-00e8f67e4eaa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:36.300016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 848/1689] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:36 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:36.303990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f0e27-681a-449a-a49e-8837b47f20c9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:36.313936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1f0e27-681a-449a-a49e-8837b47f20c9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:36.322879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493b38-35c1-41fb-a517-381fe576b52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:36.323808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493b38-35c1-41fb-a517-381fe576b52f admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.324087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493b38-35c1-41fb-a517-381fe576b52f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.324358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40493b38-35c1-41fb-a517-381fe576b52f admin admin] PATH_INFO: `/v3/projects/35a7a9408f6f4c27a66f2160763105b9/users/a3defdb369fd4569b7e40352d865a2b6/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.350412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493b38-35c1-41fb-a517-381fe576b52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a7a9408f6f4c27a66f2160763105b9, user_id=a3defdb369fd4569b7e40352d865a2b6, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:36.353219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40493b38-35c1-41fb-a517-381fe576b52f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:36.420569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 842/1690] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:36 2021] PUT /identity/v3/projects/35a7a9408f6f4c27a66f2160763105b9/users/a3defdb369fd4569b7e40352d865a2b6/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:36.471721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c4c90-e16c-4d17-bca4-6b55e14d5364 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.471721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c4c90-e16c-4d17-bca4-6b55e14d5364 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.471721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c4c90-e16c-4d17-bca4-6b55e14d5364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.474075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-441c4c90-e16c-4d17-bca4-6b55e14d5364 None None] MFA Rules not processed for user `a3defdb369fd4569b7e40352d865a2b6`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:36.475392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-441c4c90-e16c-4d17-bca4-6b55e14d5364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:36.545093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 849/1691] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:36 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:36.549278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493b38-35c1-41fb-a517-381fe576b52f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:36.615312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40493b38-35c1-41fb-a517-381fe576b52f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:36.620813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34dfbc-6b06-463e-9165-206be4c18b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:36.621469 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34dfbc-6b06-463e-9165-206be4c18b9e admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.621752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34dfbc-6b06-463e-9165-206be4c18b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.622046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34dfbc-6b06-463e-9165-206be4c18b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.622772 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34dfbc-6b06-463e-9165-206be4c18b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:36.624678 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34dfbc-6b06-463e-9165-206be4c18b9e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:36.702737 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 843/1692] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:36 2021] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:36.708163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c4c90-e16c-4d17-bca4-6b55e14d5364 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:36.721480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c4c90-e16c-4d17-bca4-6b55e14d5364 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:36.785322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e3e57-bdd7-4163-b48e-a5bbf1ba2246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:36.786009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e3e57-bdd7-4163-b48e-a5bbf1ba2246 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.786349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e3e57-bdd7-4163-b48e-a5bbf1ba2246 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.786630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692e3e57-bdd7-4163-b48e-a5bbf1ba2246 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.787378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e3e57-bdd7-4163-b48e-a5bbf1ba2246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:36.789364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692e3e57-bdd7-4163-b48e-a5bbf1ba2246 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:36.923667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 850/1693] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:36 2021] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:36.927649 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34dfbc-6b06-463e-9165-206be4c18b9e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:36.938664 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34dfbc-6b06-463e-9165-206be4c18b9e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:36.943164 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d8e48-a656-4051-bfdf-34f679364e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:36.943932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d8e48-a656-4051-bfdf-34f679364e34 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.944238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d8e48-a656-4051-bfdf-34f679364e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.944691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d8e48-a656-4051-bfdf-34f679364e34 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.945362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d8e48-a656-4051-bfdf-34f679364e34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:36.946969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430d8e48-a656-4051-bfdf-34f679364e34 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:36.957346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 844/1694] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:36.961561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e3e57-bdd7-4163-b48e-a5bbf1ba2246 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:36.971048 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692e3e57-bdd7-4163-b48e-a5bbf1ba2246 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:36.975469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80730dd2-a485-4659-a240-8441367dc2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:36.976818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80730dd2-a485-4659-a240-8441367dc2e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:36.977091 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80730dd2-a485-4659-a240-8441367dc2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:36.977356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80730dd2-a485-4659-a240-8441367dc2e6 admin admin] PATH_INFO: `/v3/projects/fb7ec30a8bba4236a76a41616886f8e2/users/0c4fa7201aaa4aa69f2634c430b57894/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:36.992655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80730dd2-a485-4659-a240-8441367dc2e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7ec30a8bba4236a76a41616886f8e2, user_id=0c4fa7201aaa4aa69f2634c430b57894, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:36.995337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80730dd2-a485-4659-a240-8441367dc2e6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:37.066737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 851/1695] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:36 2021] PUT /identity/v3/projects/fb7ec30a8bba4236a76a41616886f8e2/users/0c4fa7201aaa4aa69f2634c430b57894/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:37.070891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d8e48-a656-4051-bfdf-34f679364e34 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:37.086866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430d8e48-a656-4051-bfdf-34f679364e34 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:37.128223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80730dd2-a485-4659-a240-8441367dc2e6 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:37.152202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa3a49-f747-4443-a8fa-01c5d10707f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:37.153180 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa3a49-f747-4443-a8fa-01c5d10707f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:37.153630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa3a49-f747-4443-a8fa-01c5d10707f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:37.154121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefa3a49-f747-4443-a8fa-01c5d10707f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:37.155392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa3a49-f747-4443-a8fa-01c5d10707f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:37.158219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefa3a49-f747-4443-a8fa-01c5d10707f2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:37.174262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 845/1696] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:37 2021] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:37.178362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa3a49-f747-4443-a8fa-01c5d10707f2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:37.188149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefa3a49-f747-4443-a8fa-01c5d10707f2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:37.192933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81760449-38ed-4e6d-8119-63d3b643db2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:37.193780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81760449-38ed-4e6d-8119-63d3b643db2c admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:37.194079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81760449-38ed-4e6d-8119-63d3b643db2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:37.194382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81760449-38ed-4e6d-8119-63d3b643db2c admin admin] PATH_INFO: `/v3/projects/fb7ec30a8bba4236a76a41616886f8e2/users/0c4fa7201aaa4aa69f2634c430b57894/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:37.196427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81760449-38ed-4e6d-8119-63d3b643db2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb7ec30a8bba4236a76a41616886f8e2, user_id=0c4fa7201aaa4aa69f2634c430b57894, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:37.199032 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81760449-38ed-4e6d-8119-63d3b643db2c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:37.203402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80730dd2-a485-4659-a240-8441367dc2e6 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:37.208852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 846/1697] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:37 2021] PUT /identity/v3/projects/fb7ec30a8bba4236a76a41616886f8e2/users/0c4fa7201aaa4aa69f2634c430b57894/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:37.220426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b61638-08a8-43de-8c5f-62c6ae957c56 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:37.220711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b61638-08a8-43de-8c5f-62c6ae957c56 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:37.220989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b61638-08a8-43de-8c5f-62c6ae957c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:37.247729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e2b61638-08a8-43de-8c5f-62c6ae957c56 None None] MFA Rules not processed for user `0c4fa7201aaa4aa69f2634c430b57894`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:37.248954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e2b61638-08a8-43de-8c5f-62c6ae957c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:37.258467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:37.261039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:37.261039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:37.261039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] PATH_INFO: `/v3/users/4ee4f926ec8b4a39bac39ae71214747f` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:37.261307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee4f926ec8b4a39bac39ae71214747f)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:37.263109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:37.320430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 847/1698] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:37 2021] POST /identity/v3/auth/tokens => generated 3456 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:37.330413 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b61638-08a8-43de-8c5f-62c6ae957c56 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:37.387462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b61638-08a8-43de-8c5f-62c6ae957c56 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:37.391069 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a415ad-bffa-4860-beae-5baa8e89b4e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:37.391707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a415ad-bffa-4860-beae-5baa8e89b4e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:37.391985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a415ad-bffa-4860-beae-5baa8e89b4e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:37.392258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a415ad-bffa-4860-beae-5baa8e89b4e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:37.401128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a415ad-bffa-4860-beae-5baa8e89b4e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:37.404588 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a415ad-bffa-4860-beae-5baa8e89b4e6 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:37.412038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 848/1699] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:37 2021] GET /identity/v3/auth/tokens => generated 3456 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:37.413427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956cea0-962e-4346-8a3d-ecf37fe01ae1 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:37.413794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956cea0-962e-4346-8a3d-ecf37fe01ae1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:37.414205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956cea0-962e-4346-8a3d-ecf37fe01ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:37.435333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8956cea0-962e-4346-8a3d-ecf37fe01ae1 None None] MFA Rules not processed for user `66c74b04afed4aabbdbee054438a4933`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:37.436982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8956cea0-962e-4346-8a3d-ecf37fe01ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:37.496650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 849/1700] 10.222.0.36 () {58 vars in 1015 bytes} [Wed Oct 27 01:19:37 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:37.559451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956cea0-962e-4346-8a3d-ecf37fe01ae1 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:37.561643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8956cea0-962e-4346-8a3d-ecf37fe01ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:37.573274 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956cea0-962e-4346-8a3d-ecf37fe01ae1 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:37.576998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341154b3-332b-446f-a143-d39220399657 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:37.577641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341154b3-332b-446f-a143-d39220399657 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:37.577917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341154b3-332b-446f-a143-d39220399657 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:37.578230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341154b3-332b-446f-a143-d39220399657 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:37.585470 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341154b3-332b-446f-a143-d39220399657 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:37.586899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341154b3-332b-446f-a143-d39220399657 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:37.594492 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 850/1701] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:37 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:37.687529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee4f926ec8b4a39bac39ae71214747f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:37.710360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee4f926ec8b4a39bac39ae71214747f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:37.719336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee4f926ec8b4a39bac39ae71214747f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:37.814224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee4f926ec8b4a39bac39ae71214747f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:37.815127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee4f926ec8b4a39bac39ae71214747f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:37.832330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 852/1702] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:37 2021] DELETE /identity/v3/users/4ee4f926ec8b4a39bac39ae71214747f => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:37.836154 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02454d9-15fd-416c-a11e-81beeab7f3cd None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:37.837416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02454d9-15fd-416c-a11e-81beeab7f3cd None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:37.845127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02454d9-15fd-416c-a11e-81beeab7f3cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:37.885059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c02454d9-15fd-416c-a11e-81beeab7f3cd None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:37.887573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c02454d9-15fd-416c-a11e-81beeab7f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:37.978092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 851/1703] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:37 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:37.988268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:37.989689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:38.072758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d4dde1-e882-4eb1-943a-6b0984b6ab78 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:38.076900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d362e4-c69f-4de5-bd35-180d5d7d698b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:38.080271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d362e4-c69f-4de5-bd35-180d5d7d698b service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:38.080271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d362e4-c69f-4de5-bd35-180d5d7d698b service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:38.080271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d362e4-c69f-4de5-bd35-180d5d7d698b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:38.088551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d362e4-c69f-4de5-bd35-180d5d7d698b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:38.089906 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d362e4-c69f-4de5-bd35-180d5d7d698b service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:38.099567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 853/1704] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:38.619616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02454d9-15fd-416c-a11e-81beeab7f3cd None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:38.622125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c02454d9-15fd-416c-a11e-81beeab7f3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:38.643412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02454d9-15fd-416c-a11e-81beeab7f3cd None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:38.649905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:38.650923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:38.651407 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:38.651947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] PATH_INFO: `/v3/projects/2f905f4273f443a59c1103b161c52e13` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:38.653734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2f905f4273f443a59c1103b161c52e13)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:38.657873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:38.687983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661bb80-463d-49b9-889c-32a7e29944fc None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:38.688420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661bb80-463d-49b9-889c-32a7e29944fc None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:38.688844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2661bb80-463d-49b9-889c-32a7e29944fc None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:38.690792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 854/1705] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:19:38 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:19:38.735248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226c76d-6c12-45c5-a268-41912ccacf53 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:38.735752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226c76d-6c12-45c5-a268-41912ccacf53 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:38.736297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226c76d-6c12-45c5-a268-41912ccacf53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:38.797812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-7226c76d-6c12-45c5-a268-41912ccacf53 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:38.799385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7226c76d-6c12-45c5-a268-41912ccacf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:38.846876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2f905f4273f443a59c1103b161c52e13', 'request_id': 'req-9d282483-bdda-41a5-a8fa-75752f55e44a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:38.877802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2f905f4273f443a59c1103b161c52e13', 'request_id': 'req-9d282483-bdda-41a5-a8fa-75752f55e44a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:38.904238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2f905f4273f443a59c1103b161c52e13', 'request_id': 'req-9d282483-bdda-41a5-a8fa-75752f55e44a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:38.945915 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 855/1706] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:19:38 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:38.955193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226c76d-6c12-45c5-a268-41912ccacf53 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:38.957154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7226c76d-6c12-45c5-a268-41912ccacf53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:38.986205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226c76d-6c12-45c5-a268-41912ccacf53 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:38.989957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] The token cache is being invalidate because project 2f905f4273f443a59c1103b161c52e13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:38.990582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:38.992183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:38.996691 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64737cc4-6498-4bbd-94a2-a834ff265431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:38.997732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64737cc4-6498-4bbd-94a2-a834ff265431 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:38.998194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64737cc4-6498-4bbd-94a2-a834ff265431 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:38.998629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64737cc4-6498-4bbd-94a2-a834ff265431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:38.999401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 852/1707] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:38 2021] DELETE /identity/v3/projects/2f905f4273f443a59c1103b161c52e13 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:39.003089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:39.003470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-64737cc4-6498-4bbd-94a2-a834ff265431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:39.008810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:39.025930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64737cc4-6498-4bbd-94a2-a834ff265431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:39.031669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64737cc4-6498-4bbd-94a2-a834ff265431 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:39.045533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 856/1708] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:38 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:39.216478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d282483-bdda-41a5-a8fa-75752f55e44a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:39.244857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:39.245963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:39.249838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:39.249838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] PATH_INFO: `/v3/users/0a7963df93db4b0c83e94d6032b2393c` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:39.249838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a7963df93db4b0c83e94d6032b2393c)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:39.252495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:39.536441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a7963df93db4b0c83e94d6032b2393c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:39.554633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a7963df93db4b0c83e94d6032b2393c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:39.560260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a7963df93db4b0c83e94d6032b2393c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:39.560986 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a7963df93db4b0c83e94d6032b2393c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:39.665973 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-09fe0b3c-03ee-41b9-8cdc-564908c045d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a7963df93db4b0c83e94d6032b2393c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:39.685675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 853/1709] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:39 2021] DELETE /identity/v3/users/0a7963df93db4b0c83e94d6032b2393c => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:40.973613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64737cc4-6498-4bbd-94a2-a834ff265431 service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:41.004215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64737cc4-6498-4bbd-94a2-a834ff265431 service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:41.113428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:41.114564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:41.114845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:41.117415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] PATH_INFO: `/v3/projects/8c3bb059d5324fb195076d863d7d950a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:41.120281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c3bb059d5324fb195076d863d7d950a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:41.126740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:41.305076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c3bb059d5324fb195076d863d7d950a', 'request_id': 'req-52965f60-5317-4bb3-896a-982cadcb5f08'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:41.327781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c3bb059d5324fb195076d863d7d950a', 'request_id': 'req-52965f60-5317-4bb3-896a-982cadcb5f08'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:41.335439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c3bb059d5324fb195076d863d7d950a', 'request_id': 'req-52965f60-5317-4bb3-896a-982cadcb5f08'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:41.426345 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] The token cache is being invalidate because project 8c3bb059d5324fb195076d863d7d950a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:41.426663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:41.427462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52965f60-5317-4bb3-896a-982cadcb5f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:41.430651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 857/1710] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:40 2021] DELETE /identity/v3/projects/8c3bb059d5324fb195076d863d7d950a => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:41.442485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e6f0-360b-43b8-a422-00fb3ddff548 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:41.442962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e6f0-360b-43b8-a422-00fb3ddff548 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:41.443043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9e6f0-360b-43b8-a422-00fb3ddff548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:41.467343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c9a9e6f0-360b-43b8-a422-00fb3ddff548 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:41.468546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c9a9e6f0-360b-43b8-a422-00fb3ddff548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:41.546317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 854/1711] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:41.554325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daaefd-4be4-4c71-8422-e7579b8e17a7 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:41.554609 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daaefd-4be4-4c71-8422-e7579b8e17a7 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:41.554908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23daaefd-4be4-4c71-8422-e7579b8e17a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:41.574218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-23daaefd-4be4-4c71-8422-e7579b8e17a7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:41.576008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-23daaefd-4be4-4c71-8422-e7579b8e17a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:41.585411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 858/1712] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:41.592675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9e6f0-360b-43b8-a422-00fb3ddff548 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:41.599999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daaefd-4be4-4c71-8422-e7579b8e17a7 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:41.601550 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-23daaefd-4be4-4c71-8422-e7579b8e17a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:41.605596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9e6f0-360b-43b8-a422-00fb3ddff548 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:41.612357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576357d6-c220-4b94-9434-587832268929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:41.612357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576357d6-c220-4b94-9434-587832268929 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:41.612357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576357d6-c220-4b94-9434-587832268929 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:41.612869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576357d6-c220-4b94-9434-587832268929 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:41.613612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576357d6-c220-4b94-9434-587832268929 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:41.613989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576357d6-c220-4b94-9434-587832268929 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:41.614123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23daaefd-4be4-4c71-8422-e7579b8e17a7 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:41.615715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576357d6-c220-4b94-9434-587832268929 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:41.619742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:41.620614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:41.620890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:41.621158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] PATH_INFO: `/v3/users/a3defdb369fd4569b7e40352d865a2b6` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:41.622448 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3defdb369fd4569b7e40352d865a2b6)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:41.624350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:41.631470 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 855/1713] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:41.636402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576357d6-c220-4b94-9434-587832268929 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:41.646955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576357d6-c220-4b94-9434-587832268929 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:41.653345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96a400-d712-4647-9dab-07473ce768f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:41.654008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96a400-d712-4647-9dab-07473ce768f5 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:41.654362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96a400-d712-4647-9dab-07473ce768f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:41.654632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc96a400-d712-4647-9dab-07473ce768f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:41.655331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96a400-d712-4647-9dab-07473ce768f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:41.657464 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc96a400-d712-4647-9dab-07473ce768f5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:41.764379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 856/1714] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:41 2021] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:41.765675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96a400-d712-4647-9dab-07473ce768f5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:41.841990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3defdb369fd4569b7e40352d865a2b6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:41.853754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc96a400-d712-4647-9dab-07473ce768f5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:41.860530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3defdb369fd4569b7e40352d865a2b6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:41.864092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22add7ca-77e9-442b-afb7-5114340f44d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:41.865072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22add7ca-77e9-442b-afb7-5114340f44d6 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:41.865564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22add7ca-77e9-442b-afb7-5114340f44d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:41.866547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22add7ca-77e9-442b-afb7-5114340f44d6 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:41.867676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22add7ca-77e9-442b-afb7-5114340f44d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:41.871294 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22add7ca-77e9-442b-afb7-5114340f44d6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:41.877956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3defdb369fd4569b7e40352d865a2b6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:41.997474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3defdb369fd4569b7e40352d865a2b6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:41.998134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0711117a-79d4-49b6-9b52-79a45246aa18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3defdb369fd4569b7e40352d865a2b6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:42.007837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 859/1715] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:41 2021] DELETE /identity/v3/users/a3defdb369fd4569b7e40352d865a2b6 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:42.012209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83944-23ba-4605-8b9c-a522ddfeb048 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.012498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83944-23ba-4605-8b9c-a522ddfeb048 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.012771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb83944-23ba-4605-8b9c-a522ddfeb048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.032958 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-fcb83944-23ba-4605-8b9c-a522ddfeb048 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:42.034181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fcb83944-23ba-4605-8b9c-a522ddfeb048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:42.041493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 857/1716] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:41 2021] POST /identity/v3/users => generated 289 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:42.043080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22add7ca-77e9-442b-afb7-5114340f44d6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.045260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-22add7ca-77e9-442b-afb7-5114340f44d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:42.059093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22add7ca-77e9-442b-afb7-5114340f44d6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.099243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 860/1717] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:42.109922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb83944-23ba-4605-8b9c-a522ddfeb048 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.111338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fcb83944-23ba-4605-8b9c-a522ddfeb048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:42.127873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f8b3f-7092-49dc-84ae-e6980a77bd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.128954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8b3f-7092-49dc-84ae-e6980a77bd83 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.129236 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8b3f-7092-49dc-84ae-e6980a77bd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.129507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f8b3f-7092-49dc-84ae-e6980a77bd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.130302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f8b3f-7092-49dc-84ae-e6980a77bd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:42.132432 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f8b3f-7092-49dc-84ae-e6980a77bd83 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:42.147241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 858/1718] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:42 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:42.149260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f8b3f-7092-49dc-84ae-e6980a77bd83 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.159020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f8b3f-7092-49dc-84ae-e6980a77bd83 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.166383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796128f-b352-4087-90c8-6d61efd24ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.167644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796128f-b352-4087-90c8-6d61efd24ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.169141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796128f-b352-4087-90c8-6d61efd24ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.169141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d796128f-b352-4087-90c8-6d61efd24ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.169141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796128f-b352-4087-90c8-6d61efd24ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:42.170777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d796128f-b352-4087-90c8-6d61efd24ea8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:42.173063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb83944-23ba-4605-8b9c-a522ddfeb048 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.177140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5205755-c99f-423f-bf8d-4149271ed644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.178174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205755-c99f-423f-bf8d-4149271ed644 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.178614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205755-c99f-423f-bf8d-4149271ed644 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.179058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5205755-c99f-423f-bf8d-4149271ed644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.181157 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 859/1719] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:42 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:42.185145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796128f-b352-4087-90c8-6d61efd24ea8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.191858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205755-c99f-423f-bf8d-4149271ed644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:42.193463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5205755-c99f-423f-bf8d-4149271ed644 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:42.197093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d796128f-b352-4087-90c8-6d61efd24ea8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.203076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa4915-4ebe-4e3e-851f-5a5114fca6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.203967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa4915-4ebe-4e3e-851f-5a5114fca6be admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.204248 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa4915-4ebe-4e3e-851f-5a5114fca6be admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.204535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fa4915-4ebe-4e3e-851f-5a5114fca6be admin admin] PATH_INFO: `/v3/projects/e18561f15c0948ba9b090413db6b812d/users/e5188aa4fb4545e5a804ad612df6d4cc/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.207697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 861/1720] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:42 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:42.221197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa4915-4ebe-4e3e-851f-5a5114fca6be admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18561f15c0948ba9b090413db6b812d, user_id=e5188aa4fb4545e5a804ad612df6d4cc, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:42.224092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fa4915-4ebe-4e3e-851f-5a5114fca6be admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:42.302881 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 860/1721] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:42 2021] PUT /identity/v3/projects/e18561f15c0948ba9b090413db6b812d/users/e5188aa4fb4545e5a804ad612df6d4cc/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:42.311336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e17b01-d36d-4891-9882-1a3ce21d1f60 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.311625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e17b01-d36d-4891-9882-1a3ce21d1f60 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.312326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e17b01-d36d-4891-9882-1a3ce21d1f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.348862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-59e17b01-d36d-4891-9882-1a3ce21d1f60 None None] MFA Rules not processed for user `e5188aa4fb4545e5a804ad612df6d4cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:42.350178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-59e17b01-d36d-4891-9882-1a3ce21d1f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:42.414772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 862/1722] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:42 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:42.419485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa4915-4ebe-4e3e-851f-5a5114fca6be admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.507814 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fa4915-4ebe-4e3e-851f-5a5114fca6be admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.513021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711ba95-9426-40ab-95eb-f5023a0861b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.513829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711ba95-9426-40ab-95eb-f5023a0861b6 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.514145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711ba95-9426-40ab-95eb-f5023a0861b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.514424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711ba95-9426-40ab-95eb-f5023a0861b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.515146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711ba95-9426-40ab-95eb-f5023a0861b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:42.517043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711ba95-9426-40ab-95eb-f5023a0861b6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:42.612241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 861/1723] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:42 2021] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:42.621660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e17b01-d36d-4891-9882-1a3ce21d1f60 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.641370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e17b01-d36d-4891-9882-1a3ce21d1f60 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.707539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe69c67-2913-40f3-8760-eb7c4fac2b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.708214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe69c67-2913-40f3-8760-eb7c4fac2b8b admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.708488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe69c67-2913-40f3-8760-eb7c4fac2b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.708771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe69c67-2913-40f3-8760-eb7c4fac2b8b admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.709482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe69c67-2913-40f3-8760-eb7c4fac2b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:42.711959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe69c67-2913-40f3-8760-eb7c4fac2b8b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:42.747039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711ba95-9426-40ab-95eb-f5023a0861b6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.749406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e711ba95-9426-40ab-95eb-f5023a0861b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:42.762258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711ba95-9426-40ab-95eb-f5023a0861b6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.767841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.768143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.768408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.768821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] PATH_INFO: `/v3/projects/35a7a9408f6f4c27a66f2160763105b9` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.770076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a7a9408f6f4c27a66f2160763105b9)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:42.771964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:42.803410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 863/1724] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:42 2021] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:42.807039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe69c67-2913-40f3-8760-eb7c4fac2b8b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.831035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe69c67-2913-40f3-8760-eb7c4fac2b8b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.836641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad467-5414-487f-b0bd-7a1b239bf788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.837387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad467-5414-487f-b0bd-7a1b239bf788 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.837739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad467-5414-487f-b0bd-7a1b239bf788 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.838180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ad467-5414-487f-b0bd-7a1b239bf788 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.839556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ad467-5414-487f-b0bd-7a1b239bf788 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:42.840728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ad467-5414-487f-b0bd-7a1b239bf788 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:42.856037 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 864/1725] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:42 2021] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:42.860406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad467-5414-487f-b0bd-7a1b239bf788 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.867763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a7a9408f6f4c27a66f2160763105b9', 'request_id': 'req-77d2be19-c4a9-4c7c-ae24-988788ff819e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:42.872375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ad467-5414-487f-b0bd-7a1b239bf788 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.875425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a7a9408f6f4c27a66f2160763105b9', 'request_id': 'req-77d2be19-c4a9-4c7c-ae24-988788ff819e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:42.881289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a7a9408f6f4c27a66f2160763105b9', 'request_id': 'req-77d2be19-c4a9-4c7c-ae24-988788ff819e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:42.930648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b88a6-2209-40f9-b4fc-358bd03d2d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.931540 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b88a6-2209-40f9-b4fc-358bd03d2d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:42.931811 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b88a6-2209-40f9-b4fc-358bd03d2d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:42.932075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2b88a6-2209-40f9-b4fc-358bd03d2d98 admin admin] PATH_INFO: `/v3/projects/60d76602b9e844d8a397f63016959861/users/50216ba568ca464baf3cbb878d4f233c/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:42.948162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b88a6-2209-40f9-b4fc-358bd03d2d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d76602b9e844d8a397f63016959861, user_id=50216ba568ca464baf3cbb878d4f233c, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:42.951730 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2b88a6-2209-40f9-b4fc-358bd03d2d98 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:42.973178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] The token cache is being invalidate because project 35a7a9408f6f4c27a66f2160763105b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:42.973463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:42.974116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:42.977052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 862/1726] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:42 2021] DELETE /identity/v3/projects/35a7a9408f6f4c27a66f2160763105b9 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:42.979645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:42.981035 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:42.994136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d2be19-c4a9-4c7c-ae24-988788ff819e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:42.998885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:42.999736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:43.000011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:43.000274 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] PATH_INFO: `/v3/users/0c4fa7201aaa4aa69f2634c430b57894` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:43.001507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c4fa7201aaa4aa69f2634c430b57894)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:43.003420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:43.069769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 865/1727] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:42 2021] PUT /identity/v3/projects/60d76602b9e844d8a397f63016959861/users/50216ba568ca464baf3cbb878d4f233c/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:43.072186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b88a6-2209-40f9-b4fc-358bd03d2d98 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:43.077193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3a2b88a6-2209-40f9-b4fc-358bd03d2d98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:43.147815 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2b88a6-2209-40f9-b4fc-358bd03d2d98 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:43.152748 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53362b-4162-43ee-b037-220b4434e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:43.153417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53362b-4162-43ee-b037-220b4434e148 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:43.153694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53362b-4162-43ee-b037-220b4434e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:43.153988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb53362b-4162-43ee-b037-220b4434e148 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:43.154754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53362b-4162-43ee-b037-220b4434e148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:43.156375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb53362b-4162-43ee-b037-220b4434e148 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:43.166699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 866/1728] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:43 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:43.170756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53362b-4162-43ee-b037-220b4434e148 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:43.183312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb53362b-4162-43ee-b037-220b4434e148 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:43.188418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152638e-bd82-46ba-b785-1854f630ab75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:43.189404 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152638e-bd82-46ba-b785-1854f630ab75 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:43.189651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152638e-bd82-46ba-b785-1854f630ab75 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:43.189920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152638e-bd82-46ba-b785-1854f630ab75 admin admin] PATH_INFO: `/v3/projects/60d76602b9e844d8a397f63016959861/users/50216ba568ca464baf3cbb878d4f233c/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:43.191866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c4fa7201aaa4aa69f2634c430b57894'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:43.192045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152638e-bd82-46ba-b785-1854f630ab75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d76602b9e844d8a397f63016959861, user_id=50216ba568ca464baf3cbb878d4f233c, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:43.195340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152638e-bd82-46ba-b785-1854f630ab75 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:43.205525 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c4fa7201aaa4aa69f2634c430b57894'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:43.207296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 867/1729] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:43 2021] PUT /identity/v3/projects/60d76602b9e844d8a397f63016959861/users/50216ba568ca464baf3cbb878d4f233c/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:43.213221 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c4fa7201aaa4aa69f2634c430b57894'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:43.213949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c4fa7201aaa4aa69f2634c430b57894'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:43.219616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f4515-e3f1-49ea-abee-5fb24de86ef6 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:43.219914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f4515-e3f1-49ea-abee-5fb24de86ef6 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:43.220198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36f4515-e3f1-49ea-abee-5fb24de86ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:43.247132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c36f4515-e3f1-49ea-abee-5fb24de86ef6 None None] MFA Rules not processed for user `50216ba568ca464baf3cbb878d4f233c`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:43.248318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c36f4515-e3f1-49ea-abee-5fb24de86ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:43.300061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c4fa7201aaa4aa69f2634c430b57894'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:43.307224 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 863/1730] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:42 2021] DELETE /identity/v3/users/0c4fa7201aaa4aa69f2634c430b57894 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:43.317618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 868/1731] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:43 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:43.325823 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:43.327457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:43.395582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b6f5b9-8c4b-475e-8fc3-5e152f779160 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:43.404192 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c915d-ee32-43da-9498-1c522d3aba18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:43.404842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c915d-ee32-43da-9498-1c522d3aba18 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:43.405120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c915d-ee32-43da-9498-1c522d3aba18 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:43.405390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c915d-ee32-43da-9498-1c522d3aba18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:43.476991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c915d-ee32-43da-9498-1c522d3aba18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:43.478581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c915d-ee32-43da-9498-1c522d3aba18 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:43.490086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 864/1732] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:43 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:43.978706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f4515-e3f1-49ea-abee-5fb24de86ef6 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:43.980324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c36f4515-e3f1-49ea-abee-5fb24de86ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:44.051822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36f4515-e3f1-49ea-abee-5fb24de86ef6 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:44.109712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:44.110605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:44.110875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:44.111143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] PATH_INFO: `/v3/projects/fb7ec30a8bba4236a76a41616886f8e2` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:44.112335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb7ec30a8bba4236a76a41616886f8e2)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:44.114441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:44.277253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb7ec30a8bba4236a76a41616886f8e2', 'request_id': 'req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:44.285123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb7ec30a8bba4236a76a41616886f8e2', 'request_id': 'req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:44.293117 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb7ec30a8bba4236a76a41616886f8e2', 'request_id': 'req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:44.483461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] The token cache is being invalidate because project fb7ec30a8bba4236a76a41616886f8e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:44.483857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:44.485855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:44.490084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 869/1733] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:43 2021] DELETE /identity/v3/projects/fb7ec30a8bba4236a76a41616886f8e2 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:44.496384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b641783-4f55-4800-80e8-1e372bbc39bb None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:44.496989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b641783-4f55-4800-80e8-1e372bbc39bb None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:44.496989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b641783-4f55-4800-80e8-1e372bbc39bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:44.525183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0b641783-4f55-4800-80e8-1e372bbc39bb None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:44.526952 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0b641783-4f55-4800-80e8-1e372bbc39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:44.617539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:44.619118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:44.657336 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 865/1734] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:44.665550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640475a-2b3e-47f2-9989-5e3bc1e616bf None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:44.669342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640475a-2b3e-47f2-9989-5e3bc1e616bf None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:44.669342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640475a-2b3e-47f2-9989-5e3bc1e616bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:44.705484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c640475a-2b3e-47f2-9989-5e3bc1e616bf None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:44.708495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c640475a-2b3e-47f2-9989-5e3bc1e616bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:44.714586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe67373-54d5-4b75-a1f9-0d8bf65d3e2d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:44.720793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828c62-b2cd-4737-aaef-f8a45250e447 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50216ba568ca464baf3cbb878d4f233c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d76602b9e844d8a397f63016959861', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:44.721754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828c62-b2cd-4737-aaef-f8a45250e447 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:44.722584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828c62-b2cd-4737-aaef-f8a45250e447 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:44.722584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97828c62-b2cd-4737-aaef-f8a45250e447 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:44.723298 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97828c62-b2cd-4737-aaef-f8a45250e447 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:44.723612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97828c62-b2cd-4737-aaef-f8a45250e447 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:44.726314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97828c62-b2cd-4737-aaef-f8a45250e447 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:44.729711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 866/1735] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:44.733951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640475a-2b3e-47f2-9989-5e3bc1e616bf None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:44.744808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640475a-2b3e-47f2-9989-5e3bc1e616bf None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:44.746181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 870/1736] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:44.749228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828c62-b2cd-4737-aaef-f8a45250e447 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:44.752570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce1eb-b342-4c31-98f8-f937c52cac1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:44.753295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce1eb-b342-4c31-98f8-f937c52cac1f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:44.753575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce1eb-b342-4c31-98f8-f937c52cac1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:44.753982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce1eb-b342-4c31-98f8-f937c52cac1f admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:44.754774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ce1eb-b342-4c31-98f8-f937c52cac1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:44.755064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ce1eb-b342-4c31-98f8-f937c52cac1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:44.757227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8ce1eb-b342-4c31-98f8-f937c52cac1f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:44.761493 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97828c62-b2cd-4737-aaef-f8a45250e447 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:44.767090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27d3e-faf2-432a-b269-b531e42bc6e2 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50216ba568ca464baf3cbb878d4f233c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d76602b9e844d8a397f63016959861', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:44.767927 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27d3e-faf2-432a-b269-b531e42bc6e2 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:44.768317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27d3e-faf2-432a-b269-b531e42bc6e2 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:44.768710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d27d3e-faf2-432a-b269-b531e42bc6e2 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:44.769479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 867/1737] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:44.769719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d27d3e-faf2-432a-b269-b531e42bc6e2 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:44.772513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d27d3e-faf2-432a-b269-b531e42bc6e2 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:44.774553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce1eb-b342-4c31-98f8-f937c52cac1f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:44.784805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce1eb-b342-4c31-98f8-f937c52cac1f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:44.790446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b9c79-fdad-4f6e-8e14-6da6a359ae5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:44.791098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b9c79-fdad-4f6e-8e14-6da6a359ae5c admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:44.791517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b9c79-fdad-4f6e-8e14-6da6a359ae5c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:44.791797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4b9c79-fdad-4f6e-8e14-6da6a359ae5c admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:44.792497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b9c79-fdad-4f6e-8e14-6da6a359ae5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:44.794400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4b9c79-fdad-4f6e-8e14-6da6a359ae5c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:44.930430 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 868/1738] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:44 2021] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:44.931794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b9c79-fdad-4f6e-8e14-6da6a359ae5c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:44.949474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 871/1739] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:44 2021] POST /identity/v3/projects => generated 354 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:44.956201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27d3e-faf2-432a-b269-b531e42bc6e2 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:45.095370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4b9c79-fdad-4f6e-8e14-6da6a359ae5c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:45.110084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b9e6c-bcdb-424c-998e-adb1c70f3979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:45.112932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b9e6c-bcdb-424c-998e-adb1c70f3979 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:45.113373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b9e6c-bcdb-424c-998e-adb1c70f3979 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:45.114712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b9e6c-bcdb-424c-998e-adb1c70f3979 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:45.120072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b9e6c-bcdb-424c-998e-adb1c70f3979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:45.130222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b9e6c-bcdb-424c-998e-adb1c70f3979 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:45.206296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d27d3e-faf2-432a-b269-b531e42bc6e2 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:45.288629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 869/1740] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:44 2021] POST /identity/v3/users => generated 292 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:45.291949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b9e6c-bcdb-424c-998e-adb1c70f3979 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:45.354414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b9e6c-bcdb-424c-998e-adb1c70f3979 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:45.388002 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466e03bb-e326-403a-a18f-9cbb8cf46469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:45.390265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e03bb-e326-403a-a18f-9cbb8cf46469 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:45.394348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e03bb-e326-403a-a18f-9cbb8cf46469 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:45.394654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466e03bb-e326-403a-a18f-9cbb8cf46469 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:45.395505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e03bb-e326-403a-a18f-9cbb8cf46469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:45.409090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352fe72-ca9a-4822-8328-4e1cb85db830 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50216ba568ca464baf3cbb878d4f233c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d76602b9e844d8a397f63016959861', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:45.410064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352fe72-ca9a-4822-8328-4e1cb85db830 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:45.410191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352fe72-ca9a-4822-8328-4e1cb85db830 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:45.410708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352fe72-ca9a-4822-8328-4e1cb85db830 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:45.411210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466e03bb-e326-403a-a18f-9cbb8cf46469 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:45.411613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352fe72-ca9a-4822-8328-4e1cb85db830 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:45.411926 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352fe72-ca9a-4822-8328-4e1cb85db830 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:45.414097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352fe72-ca9a-4822-8328-4e1cb85db830 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:45.442686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 872/1741] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:45.472336 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 870/1742] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:45 2021] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:45.477905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352fe72-ca9a-4822-8328-4e1cb85db830 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:45.540907 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352fe72-ca9a-4822-8328-4e1cb85db830 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:45.566299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b39395-7ff9-4de4-97ef-69567e415b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:45.573252 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39395-7ff9-4de4-97ef-69567e415b33 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:45.573975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9889a8-0a01-4bbf-a489-4d5c2bfd3765 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:45.574465 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9889a8-0a01-4bbf-a489-4d5c2bfd3765 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:45.574610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9889a8-0a01-4bbf-a489-4d5c2bfd3765 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:45.575892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39395-7ff9-4de4-97ef-69567e415b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:45.576122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b39395-7ff9-4de4-97ef-69567e415b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:45.577804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b39395-7ff9-4de4-97ef-69567e415b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:45.579850 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 871/1743] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:19:45 2021] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:19:45.588485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b39395-7ff9-4de4-97ef-69567e415b33 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:45.618256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0295-aaca-49d4-9b02-909258cc0856 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:45.618615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0295-aaca-49d4-9b02-909258cc0856 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:45.618946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe0295-aaca-49d4-9b02-909258cc0856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:45.654956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 873/1744] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:45 2021] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:45.655955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b39395-7ff9-4de4-97ef-69567e415b33 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:45.679382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b39395-7ff9-4de4-97ef-69567e415b33 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:45.687862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50216ba568ca464baf3cbb878d4f233c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '60d76602b9e844d8a397f63016959861', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:45.690451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:45.690451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:45.690451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] PATH_INFO: `/v3/projects/797f10437cea425d8d032455086ba244` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:45.691687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Authorizing `identity:delete_project(project_id=797f10437cea425d8d032455086ba244)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:45.693319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:45.712853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-5fbe0295-aaca-49d4-9b02-909258cc0856 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:45.716153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5fbe0295-aaca-49d4-9b02-909258cc0856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:45.853943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '797f10437cea425d8d032455086ba244', 'request_id': 'req-effca749-a099-4748-810a-feb714718ad5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:45.877240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '797f10437cea425d8d032455086ba244', 'request_id': 'req-effca749-a099-4748-810a-feb714718ad5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:45.877858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 872/1745] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:19:45 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:45.878799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0295-aaca-49d4-9b02-909258cc0856 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:45.892415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '797f10437cea425d8d032455086ba244', 'request_id': 'req-effca749-a099-4748-810a-feb714718ad5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:45.900121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe0295-aaca-49d4-9b02-909258cc0856 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:45.975237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] The token cache is being invalidate because project 797f10437cea425d8d032455086ba244 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:45.975411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:45.976879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:45.980095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 874/1746] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:45 2021] DELETE /identity/v3/projects/797f10437cea425d8d032455086ba244 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:45.981250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:45.997381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:46.052308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d2935-9d12-43d8-83c2-882b4d493e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:46.054352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d2935-9d12-43d8-83c2-882b4d493e76 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:46.054856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d2935-9d12-43d8-83c2-882b4d493e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:46.054970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d2935-9d12-43d8-83c2-882b4d493e76 admin admin] PATH_INFO: `/v3/projects/386833d36408416d97bdca05a944c910/users/7983085b46934c3b8a51097960da2119/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:46.086815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d2935-9d12-43d8-83c2-882b4d493e76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=386833d36408416d97bdca05a944c910, user_id=7983085b46934c3b8a51097960da2119, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:46.090901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562d2935-9d12-43d8-83c2-882b4d493e76 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:46.152150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effca749-a099-4748-810a-feb714718ad5 tempest-VolumeQuotaClassesTest-2011642741 tempest-VolumeQuotaClassesTest-2011642741-project-admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:46.158273 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:46.159121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:46.159401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:46.159699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:46.164034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:46.184318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 873/1747] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:45 2021] PUT /identity/v3/projects/386833d36408416d97bdca05a944c910/users/7983085b46934c3b8a51097960da2119/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:46.186790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:46.188812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:46.203820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f29f3-97c9-409d-ab6d-29ca40f47e2c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:46.206111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 875/1748] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:45 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:46.206770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f29f3-97c9-409d-ab6d-29ca40f47e2c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:46.207094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8f29f3-97c9-409d-ab6d-29ca40f47e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:46.283628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-4e8f29f3-97c9-409d-ab6d-29ca40f47e2c None None] MFA Rules not processed for user `7983085b46934c3b8a51097960da2119`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:46.285759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4e8f29f3-97c9-409d-ab6d-29ca40f47e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:46.464816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 874/1749] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:46 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:46.468909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:46.478212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:46.504762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88e54c7-ea65-4175-8958-9e87749b23ef service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:46.691686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332589d1-7ee9-4a5b-95b1-c5f03fb45790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:46.692556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332589d1-7ee9-4a5b-95b1-c5f03fb45790 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:46.692899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332589d1-7ee9-4a5b-95b1-c5f03fb45790 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:46.693278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332589d1-7ee9-4a5b-95b1-c5f03fb45790 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:46.694980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332589d1-7ee9-4a5b-95b1-c5f03fb45790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:46.701083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332589d1-7ee9-4a5b-95b1-c5f03fb45790 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:46.785941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3348-07fc-42d0-b09d-cf9ea60840e4 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:46.786899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3348-07fc-42d0-b09d-cf9ea60840e4 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:46.787355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293d3348-07fc-42d0-b09d-cf9ea60840e4 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:46.791688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 875/1750] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:19:46 2021] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:19:46.806261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3448-92bb-45d0-bc94-32f887550008 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:46.806829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3448-92bb-45d0-bc94-32f887550008 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:46.807378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d3448-92bb-45d0-bc94-32f887550008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:46.835504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1d1d3448-92bb-45d0-bc94-32f887550008 None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:46.837874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1d1d3448-92bb-45d0-bc94-32f887550008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:46.845724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 876/1751] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:46 2021] POST /identity/v3/projects => generated 385 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:46.851800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332589d1-7ee9-4a5b-95b1-c5f03fb45790 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:46.986212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 876/1752] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:19:46 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:46.988125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d3448-92bb-45d0-bc94-32f887550008 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:46.990760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1d1d3448-92bb-45d0-bc94-32f887550008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:47.014000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d3448-92bb-45d0-bc94-32f887550008 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:47.021617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:47.023344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.023821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.024284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] PATH_INFO: `/v3/users/e5188aa4fb4545e5a804ad612df6d4cc` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.026512 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5188aa4fb4545e5a804ad612df6d4cc)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:47.030045 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:47.040029 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332589d1-7ee9-4a5b-95b1-c5f03fb45790 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:47.073619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e5c60-59d0-40ee-8581-cf135f767e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:47.075134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e5c60-59d0-40ee-8581-cf135f767e14 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.076177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e5c60-59d0-40ee-8581-cf135f767e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.076865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e5c60-59d0-40ee-8581-cf135f767e14 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.081214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e5c60-59d0-40ee-8581-cf135f767e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:47.102781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e5c60-59d0-40ee-8581-cf135f767e14 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:47.274421 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 877/1753] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:46 2021] POST /identity/v3/users => generated 299 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:47.275327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e5c60-59d0-40ee-8581-cf135f767e14 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:47.289116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5188aa4fb4545e5a804ad612df6d4cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:47.320344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5188aa4fb4545e5a804ad612df6d4cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:47.333279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5188aa4fb4545e5a804ad612df6d4cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:47.350409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5188aa4fb4545e5a804ad612df6d4cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:47.388585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e5c60-59d0-40ee-8581-cf135f767e14 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:47.394357 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda0c78-ab02-48b3-89e5-b4d22cd74de3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:47.395532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda0c78-ab02-48b3-89e5-b4d22cd74de3 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.395532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda0c78-ab02-48b3-89e5-b4d22cd74de3 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.395830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda0c78-ab02-48b3-89e5-b4d22cd74de3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.407042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda0c78-ab02-48b3-89e5-b4d22cd74de3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:47.413437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda0c78-ab02-48b3-89e5-b4d22cd74de3 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:47.421855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 878/1754] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:47 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:47.423224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda0c78-ab02-48b3-89e5-b4d22cd74de3 service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:47.435246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda0c78-ab02-48b3-89e5-b4d22cd74de3 service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:47.442920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d971376-0a8e-4ba9-a52b-81fa5bd7852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:47.444863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d971376-0a8e-4ba9-a52b-81fa5bd7852c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.444863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d971376-0a8e-4ba9-a52b-81fa5bd7852c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.445083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d971376-0a8e-4ba9-a52b-81fa5bd7852c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.445764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d971376-0a8e-4ba9-a52b-81fa5bd7852c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:47.447399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d971376-0a8e-4ba9-a52b-81fa5bd7852c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:47.468429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 879/1755] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:47 2021] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:47.477322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d971376-0a8e-4ba9-a52b-81fa5bd7852c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:47.520026 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d971376-0a8e-4ba9-a52b-81fa5bd7852c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:47.528769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b34bb-4206-4487-8020-f082cb8c7f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:47.530815 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b34bb-4206-4487-8020-f082cb8c7f60 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.531166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b34bb-4206-4487-8020-f082cb8c7f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.531527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b34bb-4206-4487-8020-f082cb8c7f60 admin admin] PATH_INFO: `/v3/projects/4ae86240de6b45179a34a362243b1225/users/8f5abad642c242ef971bc90e85624269/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.552733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b34bb-4206-4487-8020-f082cb8c7f60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae86240de6b45179a34a362243b1225, user_id=8f5abad642c242ef971bc90e85624269, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:47.556893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b34bb-4206-4487-8020-f082cb8c7f60 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:47.586904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-307d0745-0d6e-408b-91b0-426989595312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5188aa4fb4545e5a804ad612df6d4cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:47.596245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 877/1756] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:46 2021] DELETE /identity/v3/users/e5188aa4fb4545e5a804ad612df6d4cc => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:47.605177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03185c6c-1f7c-4997-99a2-4f577ad94e7d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.605926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03185c6c-1f7c-4997-99a2-4f577ad94e7d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.606577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03185c6c-1f7c-4997-99a2-4f577ad94e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.628402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-03185c6c-1f7c-4997-99a2-4f577ad94e7d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:47.629758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-03185c6c-1f7c-4997-99a2-4f577ad94e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:47.643132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 880/1757] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:47 2021] PUT /identity/v3/projects/4ae86240de6b45179a34a362243b1225/users/8f5abad642c242ef971bc90e85624269/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:47.648424 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b34bb-4206-4487-8020-f082cb8c7f60 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:47.650940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b77b34bb-4206-4487-8020-f082cb8c7f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:47.705751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 878/1758] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:47.717717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03185c6c-1f7c-4997-99a2-4f577ad94e7d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:47.719173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-03185c6c-1f7c-4997-99a2-4f577ad94e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:47.798449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b34bb-4206-4487-8020-f082cb8c7f60 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:47.805187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4f772-02ed-4d85-8ab3-6bb165193770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:47.806122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4f772-02ed-4d85-8ab3-6bb165193770 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.806601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4f772-02ed-4d85-8ab3-6bb165193770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.806873 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b4f772-02ed-4d85-8ab3-6bb165193770 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.807911 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4f772-02ed-4d85-8ab3-6bb165193770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:47.809616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b4f772-02ed-4d85-8ab3-6bb165193770 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:47.814713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03185c6c-1f7c-4997-99a2-4f577ad94e7d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:47.824317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 881/1759] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:47 2021] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:47.828868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4f772-02ed-4d85-8ab3-6bb165193770 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:47.842274 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b4f772-02ed-4d85-8ab3-6bb165193770 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:47.847040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2649c8-641e-4034-b8c5-358b16364dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:47.848027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2649c8-641e-4034-b8c5-358b16364dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.848511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2649c8-641e-4034-b8c5-358b16364dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.849039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2649c8-641e-4034-b8c5-358b16364dd5 admin admin] PATH_INFO: `/v3/projects/4ae86240de6b45179a34a362243b1225/users/8f5abad642c242ef971bc90e85624269/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.851164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2649c8-641e-4034-b8c5-358b16364dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae86240de6b45179a34a362243b1225, user_id=8f5abad642c242ef971bc90e85624269, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:47.855167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2649c8-641e-4034-b8c5-358b16364dd5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:47.872826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 882/1760] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:47 2021] PUT /identity/v3/projects/4ae86240de6b45179a34a362243b1225/users/8f5abad642c242ef971bc90e85624269/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:47.880331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d59492-92bf-4a8a-ba08-078afa2d9b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:47.884491 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d59492-92bf-4a8a-ba08-078afa2d9b6f service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.884838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eef61-3387-4516-9de7-444259f90a19 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:47.885085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eef61-3387-4516-9de7-444259f90a19 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.885360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552eef61-3387-4516-9de7-444259f90a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.889754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d59492-92bf-4a8a-ba08-078afa2d9b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:47.890338 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d59492-92bf-4a8a-ba08-078afa2d9b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:47.910768 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d59492-92bf-4a8a-ba08-078afa2d9b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:47.910768 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d59492-92bf-4a8a-ba08-078afa2d9b6f service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:47.926276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 879/1761] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:47.945593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-552eef61-3387-4516-9de7-444259f90a19 None None] MFA Rules not processed for user `8f5abad642c242ef971bc90e85624269`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:47.946833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-552eef61-3387-4516-9de7-444259f90a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:48.027696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 883/1762] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:47 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:48.036903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d59492-92bf-4a8a-ba08-078afa2d9b6f service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:48.043110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-76d59492-92bf-4a8a-ba08-078afa2d9b6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:48.139851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d59492-92bf-4a8a-ba08-078afa2d9b6f service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:48.212144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e115d-a826-47ac-9a6f-5582f3f129d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:48.214385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e115d-a826-47ac-9a6f-5582f3f129d2 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:48.214385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e115d-a826-47ac-9a6f-5582f3f129d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:48.214385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e115d-a826-47ac-9a6f-5582f3f129d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:48.224255 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e115d-a826-47ac-9a6f-5582f3f129d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:48.226643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7e115d-a826-47ac-9a6f-5582f3f129d2 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:48.250139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 880/1763] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:48 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:48.278220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eef61-3387-4516-9de7-444259f90a19 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:48.384418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552eef61-3387-4516-9de7-444259f90a19 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:48.391306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:48.392315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:48.392643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:48.393863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] PATH_INFO: `/v3/users/7983085b46934c3b8a51097960da2119` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:48.396168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7983085b46934c3b8a51097960da2119)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:48.399183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:48.631876 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7983085b46934c3b8a51097960da2119'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:48.657132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7983085b46934c3b8a51097960da2119'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:48.672188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7983085b46934c3b8a51097960da2119'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:48.751085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7983085b46934c3b8a51097960da2119'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:48.755633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7983085b46934c3b8a51097960da2119'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:48.762867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 884/1764] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:48 2021] DELETE /identity/v3/users/7983085b46934c3b8a51097960da2119 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:48.766870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6261488-ef03-4c25-b3d4-2e1b95d75f53 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:48.767163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6261488-ef03-4c25-b3d4-2e1b95d75f53 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:48.767439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6261488-ef03-4c25-b3d4-2e1b95d75f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:48.788912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-a6261488-ef03-4c25-b3d4-2e1b95d75f53 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:48.791656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a6261488-ef03-4c25-b3d4-2e1b95d75f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:48.873434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 881/1765] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:48.882912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:48.889913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:48.965367 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0ecb5-1a35-4ef2-9b8e-07b0eed41d49 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:48.969004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fa608-475f-4aaf-b767-304b1bf6cc88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:48.969661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fa608-475f-4aaf-b767-304b1bf6cc88 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:48.969944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fa608-475f-4aaf-b767-304b1bf6cc88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:48.970268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fa608-475f-4aaf-b767-304b1bf6cc88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:48.981768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fa608-475f-4aaf-b767-304b1bf6cc88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:48.983544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fa608-475f-4aaf-b767-304b1bf6cc88 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:48.997751 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 885/1766] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:49.109711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6261488-ef03-4c25-b3d4-2e1b95d75f53 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:49.111618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a6261488-ef03-4c25-b3d4-2e1b95d75f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:49.133696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6261488-ef03-4c25-b3d4-2e1b95d75f53 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:49.156374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:49.156374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:49.156374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:49.156374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] PATH_INFO: `/v3/projects/e18561f15c0948ba9b090413db6b812d` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:49.157545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18561f15c0948ba9b090413db6b812d)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:49.160129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:49.317134 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18561f15c0948ba9b090413db6b812d', 'request_id': 'req-d49d607d-8065-4a5c-a15d-ba710e64318e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.323495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18561f15c0948ba9b090413db6b812d', 'request_id': 'req-d49d607d-8065-4a5c-a15d-ba710e64318e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.328887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18561f15c0948ba9b090413db6b812d', 'request_id': 'req-d49d607d-8065-4a5c-a15d-ba710e64318e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.408066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] The token cache is being invalidate because project e18561f15c0948ba9b090413db6b812d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:49.410506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.410506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.410971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 882/1767] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:49 2021] DELETE /identity/v3/projects/e18561f15c0948ba9b090413db6b812d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:49.415639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fa608-475f-4aaf-b767-304b1bf6cc88 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:49.425055 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fa608-475f-4aaf-b767-304b1bf6cc88 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:49.489442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:49.492097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:49.492097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:49.492334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] PATH_INFO: `/v3/users/50216ba568ca464baf3cbb878d4f233c` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:49.493651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50216ba568ca464baf3cbb878d4f233c)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:49.495819 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:49.681714 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50216ba568ca464baf3cbb878d4f233c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.693505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50216ba568ca464baf3cbb878d4f233c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.711176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:49.712516 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:49.728099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50216ba568ca464baf3cbb878d4f233c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.745467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d607d-8065-4a5c-a15d-ba710e64318e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:49.752457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:49.753393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:49.753750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:49.754131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] PATH_INFO: `/v3/projects/386833d36408416d97bdca05a944c910` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:49.757775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=386833d36408416d97bdca05a944c910)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:49.759806 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:49.847757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50216ba568ca464baf3cbb878d4f233c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.848525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50216ba568ca464baf3cbb878d4f233c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.857466 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 886/1768] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:49 2021] DELETE /identity/v3/users/50216ba568ca464baf3cbb878d4f233c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:49.898116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '386833d36408416d97bdca05a944c910', 'request_id': 'req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.904510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '386833d36408416d97bdca05a944c910', 'request_id': 'req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.909991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '386833d36408416d97bdca05a944c910', 'request_id': 'req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.982420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] The token cache is being invalidate because project 386833d36408416d97bdca05a944c910 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:49.991409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.992957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:49.994745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 883/1769] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:49 2021] DELETE /identity/v3/projects/386833d36408416d97bdca05a944c910 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:49.998667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:50.000799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:50.069710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d691c3-014f-4063-91a3-4a41ee19bf5b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:50.133478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:50.134448 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:50.134732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:50.135276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] PATH_INFO: `/v3/users/8f5abad642c242ef971bc90e85624269` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:50.136977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f5abad642c242ef971bc90e85624269)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:50.139463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:50.221972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:50.223438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:50.259529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4d18e-11c0-4e10-9f98-e9b24d5b6d30 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:50.265395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:50.266789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:50.267431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:50.268219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] PATH_INFO: `/v3/users/e5adbf9794344f89b56ac14f09ac6851` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:50.269694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5adbf9794344f89b56ac14f09ac6851)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:50.272414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:50.304766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f5abad642c242ef971bc90e85624269'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.321533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f5abad642c242ef971bc90e85624269'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.331593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f5abad642c242ef971bc90e85624269'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.471432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f5abad642c242ef971bc90e85624269'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.472131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f5abad642c242ef971bc90e85624269'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.495275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 887/1770] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:49 2021] DELETE /identity/v3/users/8f5abad642c242ef971bc90e85624269 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:50.495275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:50.497611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:50.529968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5adbf9794344f89b56ac14f09ac6851'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.544610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5adbf9794344f89b56ac14f09ac6851'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.554684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5adbf9794344f89b56ac14f09ac6851'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.556518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5adbf9794344f89b56ac14f09ac6851'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.599022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d74dc9-b5eb-4630-98fa-41f0cf219cf2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:50.604835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:50.605885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:50.606302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:50.606828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] PATH_INFO: `/v3/projects/60d76602b9e844d8a397f63016959861` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:50.608278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d76602b9e844d8a397f63016959861)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:50.610597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:50.630861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-91d75f05-f425-4663-b26d-fad35cd9a62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5adbf9794344f89b56ac14f09ac6851'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.642149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 884/1771] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:50 2021] DELETE /identity/v3/users/e5adbf9794344f89b56ac14f09ac6851 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:50.645156 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceed73-49b9-4fd3-a89e-160a08977393 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:50.645475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceed73-49b9-4fd3-a89e-160a08977393 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:50.645754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ceed73-49b9-4fd3-a89e-160a08977393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:50.666217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-13ceed73-49b9-4fd3-a89e-160a08977393 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:50.667431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-13ceed73-49b9-4fd3-a89e-160a08977393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:50.738610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 885/1772] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:50.761615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceed73-49b9-4fd3-a89e-160a08977393 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:50.766010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-13ceed73-49b9-4fd3-a89e-160a08977393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:50.775358 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d76602b9e844d8a397f63016959861', 'request_id': 'req-7fdd8ca5-a2dc-431d-be93-5a946caa1506'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.781908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d76602b9e844d8a397f63016959861', 'request_id': 'req-7fdd8ca5-a2dc-431d-be93-5a946caa1506'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.788897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d76602b9e844d8a397f63016959861', 'request_id': 'req-7fdd8ca5-a2dc-431d-be93-5a946caa1506'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.861450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ceed73-49b9-4fd3-a89e-160a08977393 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:50.872410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] The token cache is being invalidate because project 60d76602b9e844d8a397f63016959861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:50.874734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.874734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7fdd8ca5-a2dc-431d-be93-5a946caa1506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:50.876442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 888/1773] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:50 2021] DELETE /identity/v3/projects/60d76602b9e844d8a397f63016959861 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:50.882853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb42793-a0a4-404c-a9dd-913072748e6d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:50.883578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb42793-a0a4-404c-a9dd-913072748e6d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:50.883578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb42793-a0a4-404c-a9dd-913072748e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:50.937184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-0fb42793-a0a4-404c-a9dd-913072748e6d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:50.939576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0fb42793-a0a4-404c-a9dd-913072748e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:50.944155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:50.946274 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:50.946918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:50.947571 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:50.950926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:51.081307 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.085873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.101213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 886/1774] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:51.102650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.104526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:51.118004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 889/1775] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:50 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:51.118856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5068ea3e-b864-4fbb-a02e-e27ab079a67b service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.126982 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27689-bff0-4e20-815a-b5e3aec88ef0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.127338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27689-bff0-4e20-815a-b5e3aec88ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.127670 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d27689-bff0-4e20-815a-b5e3aec88ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.137638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.141164 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.141663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.142149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] PATH_INFO: `/v3/projects/4ae86240de6b45179a34a362243b1225` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.145531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae86240de6b45179a34a362243b1225)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.150137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-56d27689-bff0-4e20-815a-b5e3aec88ef0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:51.151435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-56d27689-bff0-4e20-815a-b5e3aec88ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:51.152890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.164920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 890/1776] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:51.166578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27689-bff0-4e20-815a-b5e3aec88ef0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.200237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d27689-bff0-4e20-815a-b5e3aec88ef0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.207490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64943-4db9-4ff5-9792-c10101cfdbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.208388 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64943-4db9-4ff5-9792-c10101cfdbe0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.208670 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64943-4db9-4ff5-9792-c10101cfdbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.209041 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64943-4db9-4ff5-9792-c10101cfdbe0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.211551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64943-4db9-4ff5-9792-c10101cfdbe0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:51.211843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64943-4db9-4ff5-9792-c10101cfdbe0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.213579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64943-4db9-4ff5-9792-c10101cfdbe0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.228580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 891/1777] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:51.233545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64943-4db9-4ff5-9792-c10101cfdbe0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.247468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64943-4db9-4ff5-9792-c10101cfdbe0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.252806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9d02-0ca9-4c0b-aea7-7661754aed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.253572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9d02-0ca9-4c0b-aea7-7661754aed96 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.253920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9d02-0ca9-4c0b-aea7-7661754aed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.254367 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee9d02-0ca9-4c0b-aea7-7661754aed96 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.255150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee9d02-0ca9-4c0b-aea7-7661754aed96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.258421 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee9d02-0ca9-4c0b-aea7-7661754aed96 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.327103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae86240de6b45179a34a362243b1225', 'request_id': 'req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.333123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae86240de6b45179a34a362243b1225', 'request_id': 'req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.339357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae86240de6b45179a34a362243b1225', 'request_id': 'req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.415022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 892/1778] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:51 2021] POST /identity/v3/projects => generated 407 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:51.416067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9d02-0ca9-4c0b-aea7-7661754aed96 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.423045 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] The token cache is being invalidate because project 4ae86240de6b45179a34a362243b1225 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:51.423337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.424136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8c524ffe-4ee6-4f44-bf30-ed548e58e7a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.426537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 887/1779] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:51 2021] DELETE /identity/v3/projects/4ae86240de6b45179a34a362243b1225 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:51.433138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc044-db5a-405d-b772-804a326e8e80 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.433546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc044-db5a-405d-b772-804a326e8e80 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.435362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbcc044-db5a-405d-b772-804a326e8e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.453490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1bbcc044-db5a-405d-b772-804a326e8e80 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:51.458294 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1bbcc044-db5a-405d-b772-804a326e8e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:51.490702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee9d02-0ca9-4c0b-aea7-7661754aed96 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.502665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586d66b-8e65-459b-9713-2e0949b8e1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.503378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586d66b-8e65-459b-9713-2e0949b8e1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.503626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586d66b-8e65-459b-9713-2e0949b8e1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.503901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5586d66b-8e65-459b-9713-2e0949b8e1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.504660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586d66b-8e65-459b-9713-2e0949b8e1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.506599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5586d66b-8e65-459b-9713-2e0949b8e1b9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.520337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 888/1780] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:51.528756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543db2a-9aef-45da-8fd3-8d61f4409ef3 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.529125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543db2a-9aef-45da-8fd3-8d61f4409ef3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.529404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543db2a-9aef-45da-8fd3-8d61f4409ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.550479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d543db2a-9aef-45da-8fd3-8d61f4409ef3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:51.550479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d543db2a-9aef-45da-8fd3-8d61f4409ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:51.558660 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 889/1781] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:51.572472 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543db2a-9aef-45da-8fd3-8d61f4409ef3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.576402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543db2a-9aef-45da-8fd3-8d61f4409ef3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.581270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.582087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.582378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.582650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.583389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:51.583694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.586040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.597683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 893/1782] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:51 2021] POST /identity/v3/users => generated 304 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:51.598804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586d66b-8e65-459b-9713-2e0949b8e1b9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.602314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5586d66b-8e65-459b-9713-2e0949b8e1b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:51.605754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 890/1783] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:51 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:51.607016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.610919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:51.626442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4fc725-6f35-4ac5-9ed0-d9166b03f352 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.630211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5586d66b-8e65-459b-9713-2e0949b8e1b9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.633783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2bc0-9cd7-4428-8d40-c1b86f34c7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.634591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2bc0-9cd7-4428-8d40-c1b86f34c7a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.635008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2bc0-9cd7-4428-8d40-c1b86f34c7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.635431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ce2bc0-9cd7-4428-8d40-c1b86f34c7a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.636317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce2bc0-9cd7-4428-8d40-c1b86f34c7a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.637803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.637932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ce2bc0-9cd7-4428-8d40-c1b86f34c7a8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.638701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.639059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.639342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] PATH_INFO: `/v3/projects/4a926bd5e8724a67805793952637c5af` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.640613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a926bd5e8724a67805793952637c5af)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.642559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.649672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 891/1784] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:51 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:51.650653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2bc0-9cd7-4428-8d40-c1b86f34c7a8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.660348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ce2bc0-9cd7-4428-8d40-c1b86f34c7a8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.666548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850979c-05de-482d-95f9-1e2c819ad8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.667311 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850979c-05de-482d-95f9-1e2c819ad8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.667715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850979c-05de-482d-95f9-1e2c819ad8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.667991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850979c-05de-482d-95f9-1e2c819ad8f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.668718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850979c-05de-482d-95f9-1e2c819ad8f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.670885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850979c-05de-482d-95f9-1e2c819ad8f0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.784575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a926bd5e8724a67805793952637c5af', 'request_id': 'req-60185eec-a083-4982-a07d-5a80ff07724e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.791181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a926bd5e8724a67805793952637c5af', 'request_id': 'req-60185eec-a083-4982-a07d-5a80ff07724e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.796656 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a926bd5e8724a67805793952637c5af', 'request_id': 'req-60185eec-a083-4982-a07d-5a80ff07724e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.803670 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 892/1785] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:51 2021] POST /identity/v3/projects => generated 397 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:51.804553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850979c-05de-482d-95f9-1e2c819ad8f0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.864313 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850979c-05de-482d-95f9-1e2c819ad8f0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.869324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f994ba-1708-4b75-ba12-37e3efe3cbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.869990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f994ba-1708-4b75-ba12-37e3efe3cbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.874468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f994ba-1708-4b75-ba12-37e3efe3cbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.874468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f994ba-1708-4b75-ba12-37e3efe3cbf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.874777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] The token cache is being invalidate because project 4a926bd5e8724a67805793952637c5af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:51.874858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f994ba-1708-4b75-ba12-37e3efe3cbf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.874925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.874925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:51.875059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f994ba-1708-4b75-ba12-37e3efe3cbf8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.875125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 894/1786] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:51 2021] DELETE /identity/v3/projects/4a926bd5e8724a67805793952637c5af => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:51.878792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.880355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:51.887284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 893/1787] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:51 2021] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:51.888470 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f994ba-1708-4b75-ba12-37e3efe3cbf8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:51.891462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c5f994ba-1708-4b75-ba12-37e3efe3cbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:51.909245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f994ba-1708-4b75-ba12-37e3efe3cbf8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.915494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.916829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.917185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.917552 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] PATH_INFO: `/v3/users/21e74ee256824efd96b0a84237efc57f` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.919199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e74ee256824efd96b0a84237efc57f)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.921302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:51.965779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60185eec-a083-4982-a07d-5a80ff07724e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:51.970923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719c90-3ec2-4cd0-b45c-275500818070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:51.971734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719c90-3ec2-4cd0-b45c-275500818070 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:51.972564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719c90-3ec2-4cd0-b45c-275500818070 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:51.972564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5719c90-3ec2-4cd0-b45c-275500818070 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:51.973283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5719c90-3ec2-4cd0-b45c-275500818070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:51.975382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5719c90-3ec2-4cd0-b45c-275500818070 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:52.118126 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 895/1788] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:51 2021] POST /identity/v3/users => generated 299 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:52.119253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719c90-3ec2-4cd0-b45c-275500818070 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:52.121468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c5719c90-3ec2-4cd0-b45c-275500818070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:52.135971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5719c90-3ec2-4cd0-b45c-275500818070 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:52.145363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6556276-ad9c-4e49-a855-3634268855c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:52.148061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556276-ad9c-4e49-a855-3634268855c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.148644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556276-ad9c-4e49-a855-3634268855c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.149019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6556276-ad9c-4e49-a855-3634268855c9 admin admin] PATH_INFO: `/v3/projects/079975aac79e4b3fba8c6ca5aa4caf2e/users/f512df00f104463cb3ffc495584995ce/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.185648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e74ee256824efd96b0a84237efc57f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:52.189835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6556276-ad9c-4e49-a855-3634268855c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=079975aac79e4b3fba8c6ca5aa4caf2e, user_id=f512df00f104463cb3ffc495584995ce, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:52.192814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6556276-ad9c-4e49-a855-3634268855c9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:52.200770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e74ee256824efd96b0a84237efc57f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:52.209310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e74ee256824efd96b0a84237efc57f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:52.211052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e74ee256824efd96b0a84237efc57f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:52.260040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e74ee256824efd96b0a84237efc57f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:52.272478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 894/1789] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:19:51 2021] DELETE /identity/v3/users/21e74ee256824efd96b0a84237efc57f => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:52.272478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:52.277772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 896/1790] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:52 2021] PUT /identity/v3/projects/079975aac79e4b3fba8c6ca5aa4caf2e/users/f512df00f104463cb3ffc495584995ce/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:52.279337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:52.288316 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f34b8-21e2-429a-8550-962ffd5a3cbe None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.288593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f34b8-21e2-429a-8550-962ffd5a3cbe None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.288854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f34b8-21e2-429a-8550-962ffd5a3cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.351845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-569f34b8-21e2-429a-8550-962ffd5a3cbe None None] MFA Rules not processed for user `f512df00f104463cb3ffc495584995ce`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:52.354997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-569f34b8-21e2-429a-8550-962ffd5a3cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:52.393443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa49dd9-8878-445f-960f-42d1613ee78a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:52.405354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8d7f7-2e9b-4a96-a750-f570dfb079ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:52.407272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8d7f7-2e9b-4a96-a750-f570dfb079ba admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.408821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8d7f7-2e9b-4a96-a750-f570dfb079ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.409513 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8d7f7-2e9b-4a96-a750-f570dfb079ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.411158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8d7f7-2e9b-4a96-a750-f570dfb079ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:52.413590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8d7f7-2e9b-4a96-a750-f570dfb079ba admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:52.425080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 895/1791] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:52 2021] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:52.429568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8d7f7-2e9b-4a96-a750-f570dfb079ba admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:52.439795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8d7f7-2e9b-4a96-a750-f570dfb079ba admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:52.446287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9702b6-9894-45a4-b77e-7867a7e82214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:52.446961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9702b6-9894-45a4-b77e-7867a7e82214 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.447386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9702b6-9894-45a4-b77e-7867a7e82214 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.447778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9702b6-9894-45a4-b77e-7867a7e82214 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.448620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9702b6-9894-45a4-b77e-7867a7e82214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:52.450483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9702b6-9894-45a4-b77e-7867a7e82214 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:52.464098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 896/1792] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:52 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:52.468440 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9702b6-9894-45a4-b77e-7867a7e82214 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:52.483462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9702b6-9894-45a4-b77e-7867a7e82214 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:52.488263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 897/1793] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:52 2021] POST /identity/v3/auth/tokens => generated 3427 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:19:52.491534 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351d0c1-3824-4bd5-b367-1744761f7aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:52.493446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351d0c1-3824-4bd5-b367-1744761f7aa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.493574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f34b8-21e2-429a-8550-962ffd5a3cbe None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:52.493736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351d0c1-3824-4bd5-b367-1744761f7aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.494489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351d0c1-3824-4bd5-b367-1744761f7aa0 admin admin] PATH_INFO: `/v3/projects/24ca2b99a51d4e7db42d5b6cbf9403eb/users/e844c830eb664c24ae4b950324026ad4/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.499218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-569f34b8-21e2-429a-8550-962ffd5a3cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:52.526108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351d0c1-3824-4bd5-b367-1744761f7aa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24ca2b99a51d4e7db42d5b6cbf9403eb, user_id=e844c830eb664c24ae4b950324026ad4, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:52.530189 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f34b8-21e2-429a-8550-962ffd5a3cbe None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:52.532018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2351d0c1-3824-4bd5-b367-1744761f7aa0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:52.536284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea649e6f-ce4a-4e9d-aeb3-2399ad7add85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:52.538138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649e6f-ce4a-4e9d-aeb3-2399ad7add85 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.538642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649e6f-ce4a-4e9d-aeb3-2399ad7add85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.539311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea649e6f-ce4a-4e9d-aeb3-2399ad7add85 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.540683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea649e6f-ce4a-4e9d-aeb3-2399ad7add85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:52.543946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea649e6f-ce4a-4e9d-aeb3-2399ad7add85 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:52.669035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 898/1795] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:52 2021] POST /identity/v3/projects => generated 409 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:52.670005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea649e6f-ce4a-4e9d-aeb3-2399ad7add85 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:52.674825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 897/1795] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:52 2021] PUT /identity/v3/projects/24ca2b99a51d4e7db42d5b6cbf9403eb/users/e844c830eb664c24ae4b950324026ad4/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:52.677182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe7bf2-ab92-42bf-a43d-098dfc3b886a None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.678018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe7bf2-ab92-42bf-a43d-098dfc3b886a None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.678999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe7bf2-ab92-42bf-a43d-098dfc3b886a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.715148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-4dfe7bf2-ab92-42bf-a43d-098dfc3b886a None None] MFA Rules not processed for user `e844c830eb664c24ae4b950324026ad4`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:52.716371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4dfe7bf2-ab92-42bf-a43d-098dfc3b886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:52.754299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea649e6f-ce4a-4e9d-aeb3-2399ad7add85 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:52.760521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db921274-a80e-47a3-9fb7-8356553276ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:52.761231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db921274-a80e-47a3-9fb7-8356553276ec admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.761562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db921274-a80e-47a3-9fb7-8356553276ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.761743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db921274-a80e-47a3-9fb7-8356553276ec admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.762489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db921274-a80e-47a3-9fb7-8356553276ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:52.764853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db921274-a80e-47a3-9fb7-8356553276ec admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:52.788743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 898/1796] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:52 2021] POST /identity/v3/auth/tokens => generated 3417 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:52.789612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe7bf2-ab92-42bf-a43d-098dfc3b886a None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:52.790907 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4dfe7bf2-ab92-42bf-a43d-098dfc3b886a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:52.805563 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfe7bf2-ab92-42bf-a43d-098dfc3b886a None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:52.810982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:52.811842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.812120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.812409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] PATH_INFO: `/v3/projects/b94552ad731746ca9b17af5642f2a49b` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.813614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b94552ad731746ca9b17af5642f2a49b)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:52.815522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:52.839962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 899/1797] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:52 2021] POST /identity/v3/users => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:52.839962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db921274-a80e-47a3-9fb7-8356553276ec admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:52.848799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db921274-a80e-47a3-9fb7-8356553276ec admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:52.854887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f5703-85df-4bbe-b7b4-c05758c8043c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:52.855514 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f5703-85df-4bbe-b7b4-c05758c8043c admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:52.855793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f5703-85df-4bbe-b7b4-c05758c8043c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:52.856067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3f5703-85df-4bbe-b7b4-c05758c8043c admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:52.857429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f5703-85df-4bbe-b7b4-c05758c8043c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:52.859696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3f5703-85df-4bbe-b7b4-c05758c8043c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:52.905217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b94552ad731746ca9b17af5642f2a49b', 'request_id': 'req-41a0976b-1bc7-4348-abbc-7b894d961042'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:52.911255 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b94552ad731746ca9b17af5642f2a49b', 'request_id': 'req-41a0976b-1bc7-4348-abbc-7b894d961042'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:52.917870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b94552ad731746ca9b17af5642f2a49b', 'request_id': 'req-41a0976b-1bc7-4348-abbc-7b894d961042'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:52.954083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 900/1798] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:52 2021] POST /identity/v3/projects => generated 399 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:52.954742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f5703-85df-4bbe-b7b4-c05758c8043c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.000343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] The token cache is being invalidate because project b94552ad731746ca9b17af5642f2a49b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:19:53.000640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:53.001320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:19:53.009009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 899/1799] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:19:52 2021] DELETE /identity/v3/projects/b94552ad731746ca9b17af5642f2a49b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:53.009009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.011742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:53.020372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3f5703-85df-4bbe-b7b4-c05758c8043c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.025223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acd100b-4ed7-48f7-92f2-3df9c006ff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.025888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd100b-4ed7-48f7-92f2-3df9c006ff57 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.026203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd100b-4ed7-48f7-92f2-3df9c006ff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.026478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acd100b-4ed7-48f7-92f2-3df9c006ff57 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.027241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd100b-4ed7-48f7-92f2-3df9c006ff57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.028889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acd100b-4ed7-48f7-92f2-3df9c006ff57 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.038783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 901/1800] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:52 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:53.040168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132725b-dd4d-432d-a507-13a3f5a346b1 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.040453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132725b-dd4d-432d-a507-13a3f5a346b1 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.040724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132725b-dd4d-432d-a507-13a3f5a346b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.063040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4132725b-dd4d-432d-a507-13a3f5a346b1 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:53.064405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4132725b-dd4d-432d-a507-13a3f5a346b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:53.083371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 902/1801] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:53.083371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132725b-dd4d-432d-a507-13a3f5a346b1 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.085228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4132725b-dd4d-432d-a507-13a3f5a346b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:53.097906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a0976b-1bc7-4348-abbc-7b894d961042 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.108406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132725b-dd4d-432d-a507-13a3f5a346b1 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.113532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070df52-0f03-477b-8f8a-ee8fad3c148f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.114386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fc43b-d349-4d06-97b4-ea1b611bebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.114521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070df52-0f03-477b-8f8a-ee8fad3c148f admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.114877 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070df52-0f03-477b-8f8a-ee8fad3c148f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.115208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fc43b-d349-4d06-97b4-ea1b611bebf4 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.115307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070df52-0f03-477b-8f8a-ee8fad3c148f admin admin] PATH_INFO: `/v3/projects/511c06534b7f49a194c6d8db7fb7bb20/users/02a3b30413a640fa9407209db732d0d0/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.116290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fc43b-d349-4d06-97b4-ea1b611bebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.116629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fc43b-d349-4d06-97b4-ea1b611bebf4 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.117463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fc43b-d349-4d06-97b4-ea1b611bebf4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.120150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664fc43b-d349-4d06-97b4-ea1b611bebf4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.132787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070df52-0f03-477b-8f8a-ee8fad3c148f admin admin] RBAC: Authorizing `identity:create_grant(project_id=511c06534b7f49a194c6d8db7fb7bb20, user_id=02a3b30413a640fa9407209db732d0d0, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.135764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0070df52-0f03-477b-8f8a-ee8fad3c148f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.209565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 900/1802] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:53 2021] POST /identity/v3/users => generated 306 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:53.212065 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15829b87-3317-4627-8786-e3f9ecb78080 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.212573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15829b87-3317-4627-8786-e3f9ecb78080 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.215494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 903/1803] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:53 2021] PUT /identity/v3/projects/511c06534b7f49a194c6d8db7fb7bb20/users/02a3b30413a640fa9407209db732d0d0/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:53.215629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15829b87-3317-4627-8786-e3f9ecb78080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.215705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070df52-0f03-477b-8f8a-ee8fad3c148f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.235707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-15829b87-3317-4627-8786-e3f9ecb78080 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:53.238903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-15829b87-3317-4627-8786-e3f9ecb78080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:53.305953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070df52-0f03-477b-8f8a-ee8fad3c148f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.309721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 901/1804] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:53 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:53.309721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15829b87-3317-4627-8786-e3f9ecb78080 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.316429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e3beb-d3b5-4acf-b1e6-9daf79061a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.317124 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e3beb-d3b5-4acf-b1e6-9daf79061a77 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.317581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e3beb-d3b5-4acf-b1e6-9daf79061a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.318016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e3beb-d3b5-4acf-b1e6-9daf79061a77 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.319375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e3beb-d3b5-4acf-b1e6-9daf79061a77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.321194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15829b87-3317-4627-8786-e3f9ecb78080 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.321501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e3beb-d3b5-4acf-b1e6-9daf79061a77 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.327509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85a737-8bde-411b-a7d3-bdc7cfa70673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.328547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85a737-8bde-411b-a7d3-bdc7cfa70673 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.329027 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85a737-8bde-411b-a7d3-bdc7cfa70673 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.329497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c85a737-8bde-411b-a7d3-bdc7cfa70673 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.330498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85a737-8bde-411b-a7d3-bdc7cfa70673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.332406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c85a737-8bde-411b-a7d3-bdc7cfa70673 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.347920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 904/1805] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:53 2021] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:53.347920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e3beb-d3b5-4acf-b1e6-9daf79061a77 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.348931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 902/1806] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:53 2021] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:53.350784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85a737-8bde-411b-a7d3-bdc7cfa70673 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.368800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e3beb-d3b5-4acf-b1e6-9daf79061a77 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.377172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c85a737-8bde-411b-a7d3-bdc7cfa70673 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.377531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c941-f4a3-4963-9882-815751de64f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.377531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c941-f4a3-4963-9882-815751de64f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.377531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c941-f4a3-4963-9882-815751de64f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.377531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799c941-f4a3-4963-9882-815751de64f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.377803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c941-f4a3-4963-9882-815751de64f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:19:53.377803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c941-f4a3-4963-9882-815751de64f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.378638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799c941-f4a3-4963-9882-815751de64f3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.378851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a70e1e-db37-41b3-813e-47a99b1a172c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.379820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70e1e-db37-41b3-813e-47a99b1a172c admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.380101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70e1e-db37-41b3-813e-47a99b1a172c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.380419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a70e1e-db37-41b3-813e-47a99b1a172c admin admin] PATH_INFO: `/v3/projects/1f7a6ec3c49b467db1d679fd06ce0bf1/users/fa6df754413c4cfa9e41baa54d0ff499/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.392363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 905/1807] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:19:53 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:19:53.393377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c941-f4a3-4963-9882-815751de64f3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.400469 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a70e1e-db37-41b3-813e-47a99b1a172c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7a6ec3c49b467db1d679fd06ce0bf1, user_id=fa6df754413c4cfa9e41baa54d0ff499, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.403672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a70e1e-db37-41b3-813e-47a99b1a172c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.405908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799c941-f4a3-4963-9882-815751de64f3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.410765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bfa1e-44d0-43b9-85d1-06bf194dffc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.411645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bfa1e-44d0-43b9-85d1-06bf194dffc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.411925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bfa1e-44d0-43b9-85d1-06bf194dffc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.412698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956bfa1e-44d0-43b9-85d1-06bf194dffc5 admin admin] PATH_INFO: `/v3/projects/511c06534b7f49a194c6d8db7fb7bb20/users/02a3b30413a640fa9407209db732d0d0/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.414725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bfa1e-44d0-43b9-85d1-06bf194dffc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511c06534b7f49a194c6d8db7fb7bb20, user_id=02a3b30413a640fa9407209db732d0d0, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.417332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956bfa1e-44d0-43b9-85d1-06bf194dffc5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.429869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 906/1808] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:53 2021] PUT /identity/v3/projects/511c06534b7f49a194c6d8db7fb7bb20/users/02a3b30413a640fa9407209db732d0d0/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:53.430580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bfa1e-44d0-43b9-85d1-06bf194dffc5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.508068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956bfa1e-44d0-43b9-85d1-06bf194dffc5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.513171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf76a10-cf59-4e9a-9ff0-3aa5aca4a6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.513822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf76a10-cf59-4e9a-9ff0-3aa5aca4a6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.514129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf76a10-cf59-4e9a-9ff0-3aa5aca4a6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.514400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf76a10-cf59-4e9a-9ff0-3aa5aca4a6c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.515192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf76a10-cf59-4e9a-9ff0-3aa5aca4a6c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.517102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf76a10-cf59-4e9a-9ff0-3aa5aca4a6c9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.538482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 903/1809] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:53 2021] PUT /identity/v3/projects/1f7a6ec3c49b467db1d679fd06ce0bf1/users/fa6df754413c4cfa9e41baa54d0ff499/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:53.538482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b4fea-59c8-4d46-b43d-0d86bb19d88f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.538482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b4fea-59c8-4d46-b43d-0d86bb19d88f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.538482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36b4fea-59c8-4d46-b43d-0d86bb19d88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.564871 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f36b4fea-59c8-4d46-b43d-0d86bb19d88f None None] MFA Rules not processed for user `02a3b30413a640fa9407209db732d0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:53.566128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f36b4fea-59c8-4d46-b43d-0d86bb19d88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:53.627890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 907/1810] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:53 2021] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:53.627890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf76a10-cf59-4e9a-9ff0-3aa5aca4a6c9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.651429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 904/1811] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:53 2021] POST /identity/v3/auth/tokens => generated 3496 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:53.652426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b4fea-59c8-4d46-b43d-0d86bb19d88f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.734823 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36b4fea-59c8-4d46-b43d-0d86bb19d88f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.737685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf76a10-cf59-4e9a-9ff0-3aa5aca4a6c9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.741386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d29182-e676-4d96-be89-0ca79baa1c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.742868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d29182-e676-4d96-be89-0ca79baa1c68 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.743112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d29182-e676-4d96-be89-0ca79baa1c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.743364 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d29182-e676-4d96-be89-0ca79baa1c68 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.744143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d29182-e676-4d96-be89-0ca79baa1c68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.745339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069c785-42a8-47c6-80e5-d26e39b59974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.746211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069c785-42a8-47c6-80e5-d26e39b59974 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.746437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d29182-e676-4d96-be89-0ca79baa1c68 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.746537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069c785-42a8-47c6-80e5-d26e39b59974 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.746741 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069c785-42a8-47c6-80e5-d26e39b59974 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.747488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069c785-42a8-47c6-80e5-d26e39b59974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.749101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8069c785-42a8-47c6-80e5-d26e39b59974 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.762061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 908/1812] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:53 2021] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:53.762181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069c785-42a8-47c6-80e5-d26e39b59974 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.767519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8069c785-42a8-47c6-80e5-d26e39b59974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:53.825142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069c785-42a8-47c6-80e5-d26e39b59974 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.828657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a1eb-32d6-462b-94a2-1da6bbed7b52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.829354 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a1eb-32d6-462b-94a2-1da6bbed7b52 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.829632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a1eb-32d6-462b-94a2-1da6bbed7b52 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.829901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8852a1eb-32d6-462b-94a2-1da6bbed7b52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.889434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852a1eb-32d6-462b-94a2-1da6bbed7b52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.890875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8852a1eb-32d6-462b-94a2-1da6bbed7b52 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.900519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 909/1813] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:53 2021] GET /identity/v3/auth/tokens => generated 3496 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:53.901599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a1eb-32d6-462b-94a2-1da6bbed7b52 service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.914502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8852a1eb-32d6-462b-94a2-1da6bbed7b52 service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.917503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 905/1814] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:53 2021] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:53.919815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d29182-e676-4d96-be89-0ca79baa1c68 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.920246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58491c13-9a86-463b-aa3e-e8ad3194fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.921554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491c13-9a86-463b-aa3e-e8ad3194fb77 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.921838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491c13-9a86-463b-aa3e-e8ad3194fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.922149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58491c13-9a86-463b-aa3e-e8ad3194fb77 admin admin] PATH_INFO: `/v3/projects/1f7a6ec3c49b467db1d679fd06ce0bf1/users/fa6df754413c4cfa9e41baa54d0ff499/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.925780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491c13-9a86-463b-aa3e-e8ad3194fb77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f7a6ec3c49b467db1d679fd06ce0bf1, user_id=fa6df754413c4cfa9e41baa54d0ff499, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.929240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58491c13-9a86-463b-aa3e-e8ad3194fb77 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.932977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d29182-e676-4d96-be89-0ca79baa1c68 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.938328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e291a-ec38-4759-b6ae-e61bdcfdc0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:53.939297 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e291a-ec38-4759-b6ae-e61bdcfdc0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.939782 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e291a-ec38-4759-b6ae-e61bdcfdc0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.940182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 910/1815] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:53 2021] PUT /identity/v3/projects/1f7a6ec3c49b467db1d679fd06ce0bf1/users/fa6df754413c4cfa9e41baa54d0ff499/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:53.940410 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e291a-ec38-4759-b6ae-e61bdcfdc0b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.941227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e291a-ec38-4759-b6ae-e61bdcfdc0b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:53.942977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e291a-ec38-4759-b6ae-e61bdcfdc0b6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:53.951602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e436d3-fc98-4cce-9fe6-c956cbd9a0bf None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:53.951956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e436d3-fc98-4cce-9fe6-c956cbd9a0bf None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:53.952299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e436d3-fc98-4cce-9fe6-c956cbd9a0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:53.957426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 906/1816] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:53 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:53.959067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e291a-ec38-4759-b6ae-e61bdcfdc0b6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:53.969148 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e291a-ec38-4759-b6ae-e61bdcfdc0b6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:53.984563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-36e436d3-fc98-4cce-9fe6-c956cbd9a0bf None None] MFA Rules not processed for user `fa6df754413c4cfa9e41baa54d0ff499`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:53.985774 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-36e436d3-fc98-4cce-9fe6-c956cbd9a0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:54.031331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb830-129b-42e7-beec-cab9aa3447fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.031992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb830-129b-42e7-beec-cab9aa3447fb admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.032279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb830-129b-42e7-beec-cab9aa3447fb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.032546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767eb830-129b-42e7-beec-cab9aa3447fb admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.033282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eb830-129b-42e7-beec-cab9aa3447fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.034890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767eb830-129b-42e7-beec-cab9aa3447fb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.045064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 907/1817] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:53 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:19:54.049089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb830-129b-42e7-beec-cab9aa3447fb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:54.059316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767eb830-129b-42e7-beec-cab9aa3447fb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:54.063882 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254ad5-b4bb-4944-8990-6b44cff2dd42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.064366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 911/1818] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:53 2021] POST /identity/v3/auth/tokens => generated 3486 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:54.064740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254ad5-b4bb-4944-8990-6b44cff2dd42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.065012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254ad5-b4bb-4944-8990-6b44cff2dd42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.065343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2254ad5-b4bb-4944-8990-6b44cff2dd42 admin admin] PATH_INFO: `/v3/projects/26523e2efcc447baae51c2b84ddcaaf4/users/80c36dfdc202476faba0853207a0b9f1/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.075467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e436d3-fc98-4cce-9fe6-c956cbd9a0bf None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:54.080741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2254ad5-b4bb-4944-8990-6b44cff2dd42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26523e2efcc447baae51c2b84ddcaaf4, user_id=80c36dfdc202476faba0853207a0b9f1, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.083404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2254ad5-b4bb-4944-8990-6b44cff2dd42 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.128956 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e436d3-fc98-4cce-9fe6-c956cbd9a0bf None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:54.132534 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203118a3-9543-4f74-85d8-f0de19a65c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.133167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203118a3-9543-4f74-85d8-f0de19a65c8a service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.133439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203118a3-9543-4f74-85d8-f0de19a65c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.133734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203118a3-9543-4f74-85d8-f0de19a65c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.142441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203118a3-9543-4f74-85d8-f0de19a65c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.143894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203118a3-9543-4f74-85d8-f0de19a65c8a service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.153012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 912/1819] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:54 2021] GET /identity/v3/auth/tokens => generated 3486 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:54.173891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 908/1820] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:54 2021] PUT /identity/v3/projects/26523e2efcc447baae51c2b84ddcaaf4/users/80c36dfdc202476faba0853207a0b9f1/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:19:54.229664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03022e61-39e5-4a09-a88b-b8d7d771648a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.229945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03022e61-39e5-4a09-a88b-b8d7d771648a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.230267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03022e61-39e5-4a09-a88b-b8d7d771648a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.258486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-03022e61-39e5-4a09-a88b-b8d7d771648a None None] MFA Rules not processed for user `80c36dfdc202476faba0853207a0b9f1`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:54.259818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-03022e61-39e5-4a09-a88b-b8d7d771648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:54.332910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 913/1821] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:54 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:54.340226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254ad5-b4bb-4944-8990-6b44cff2dd42 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:54.347098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03022e61-39e5-4a09-a88b-b8d7d771648a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:54.348865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-03022e61-39e5-4a09-a88b-b8d7d771648a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:54.408700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2254ad5-b4bb-4944-8990-6b44cff2dd42 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:54.411285 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03022e61-39e5-4a09-a88b-b8d7d771648a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:54.416653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1951a2-56a3-459b-92d7-9e49099af305 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.417310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1951a2-56a3-459b-92d7-9e49099af305 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.417850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1951a2-56a3-459b-92d7-9e49099af305 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.418268 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1951a2-56a3-459b-92d7-9e49099af305 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.420295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8b1951a2-56a3-459b-92d7-9e49099af305 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:54.424082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4477e8d-6f1a-4e62-abb2-c811312b0c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.424886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4477e8d-6f1a-4e62-abb2-c811312b0c1a admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.425269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4477e8d-6f1a-4e62-abb2-c811312b0c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.425642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4477e8d-6f1a-4e62-abb2-c811312b0c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.426494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4477e8d-6f1a-4e62-abb2-c811312b0c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.429155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4477e8d-6f1a-4e62-abb2-c811312b0c1a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.483022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1951a2-56a3-459b-92d7-9e49099af305 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.484727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1951a2-56a3-459b-92d7-9e49099af305 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.494499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 914/1822] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:54 2021] GET /identity/v3/auth/tokens => generated 3427 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:19:54.495305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1951a2-56a3-459b-92d7-9e49099af305 service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:54.503716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1951a2-56a3-459b-92d7-9e49099af305 service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:54.507880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819e530-4819-4bf9-88c2-3828552f61ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.508290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819e530-4819-4bf9-88c2-3828552f61ee service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.509781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819e530-4819-4bf9-88c2-3828552f61ee service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.509781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819e530-4819-4bf9-88c2-3828552f61ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.510739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f819e530-4819-4bf9-88c2-3828552f61ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:54.538672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 909/1823] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:54 2021] POST /identity/v3/projects => generated 385 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:19:54.542626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4477e8d-6f1a-4e62-abb2-c811312b0c1a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:54.586538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819e530-4819-4bf9-88c2-3828552f61ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.588258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819e530-4819-4bf9-88c2-3828552f61ee service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.603289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 915/1824] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:54 2021] GET /identity/v3/auth/tokens => generated 3417 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:54.627863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4477e8d-6f1a-4e62-abb2-c811312b0c1a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:54.634444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753d66a-6c64-4baf-9181-2cd2ca39ab71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.635128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d66a-6c64-4baf-9181-2cd2ca39ab71 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.635409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d66a-6c64-4baf-9181-2cd2ca39ab71 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.635784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c753d66a-6c64-4baf-9181-2cd2ca39ab71 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.636446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753d66a-6c64-4baf-9181-2cd2ca39ab71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.638541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c753d66a-6c64-4baf-9181-2cd2ca39ab71 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.739673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 910/1825] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:54 2021] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:54.744292 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819e530-4819-4bf9-88c2-3828552f61ee service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:54.754879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819e530-4819-4bf9-88c2-3828552f61ee service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:54.760255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d75821-06d3-48ca-87a1-bd1c38e276e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.760972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d75821-06d3-48ca-87a1-bd1c38e276e9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.761249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d75821-06d3-48ca-87a1-bd1c38e276e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.761520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d75821-06d3-48ca-87a1-bd1c38e276e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.762278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d75821-06d3-48ca-87a1-bd1c38e276e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.763901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d75821-06d3-48ca-87a1-bd1c38e276e9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.777860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 916/1826] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:54 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:54.783037 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753d66a-6c64-4baf-9181-2cd2ca39ab71 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:54.790807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c753d66a-6c64-4baf-9181-2cd2ca39ab71 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:54.795486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf674766-f57c-4211-b0fc-28f1767f7165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.796172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf674766-f57c-4211-b0fc-28f1767f7165 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.796600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf674766-f57c-4211-b0fc-28f1767f7165 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.796878 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf674766-f57c-4211-b0fc-28f1767f7165 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.797622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf674766-f57c-4211-b0fc-28f1767f7165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.799219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf674766-f57c-4211-b0fc-28f1767f7165 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.811093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 911/1827] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:54 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:54.815563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d75821-06d3-48ca-87a1-bd1c38e276e9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:54.826420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d75821-06d3-48ca-87a1-bd1c38e276e9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:54.831290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ca249-af39-4a72-8e24-260cd376b410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:54.832186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ca249-af39-4a72-8e24-260cd376b410 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.832459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ca249-af39-4a72-8e24-260cd376b410 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.832731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75ca249-af39-4a72-8e24-260cd376b410 admin admin] PATH_INFO: `/v3/projects/892d6fc7e003438da2418f7e2c07c897/users/e20fce0202ac424e8e19c1c4d5418dd6/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:54.848555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ca249-af39-4a72-8e24-260cd376b410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=892d6fc7e003438da2418f7e2c07c897, user_id=e20fce0202ac424e8e19c1c4d5418dd6, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:54.851398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75ca249-af39-4a72-8e24-260cd376b410 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:54.968039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 917/1828] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:54 2021] PUT /identity/v3/projects/892d6fc7e003438da2418f7e2c07c897/users/e20fce0202ac424e8e19c1c4d5418dd6/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:54.978690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4632feb-24f0-4138-833c-7e5e17009529 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:54.978972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4632feb-24f0-4138-833c-7e5e17009529 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:54.979241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4632feb-24f0-4138-833c-7e5e17009529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:55.008676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e4632feb-24f0-4138-833c-7e5e17009529 None None] MFA Rules not processed for user `e20fce0202ac424e8e19c1c4d5418dd6`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:55.009924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e4632feb-24f0-4138-833c-7e5e17009529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:55.070434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 912/1829] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:54 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:55.075014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ca249-af39-4a72-8e24-260cd376b410 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:55.143959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75ca249-af39-4a72-8e24-260cd376b410 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:55.148977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e3eed-2201-4e01-87a0-254daa8f7712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:55.151187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e3eed-2201-4e01-87a0-254daa8f7712 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:55.151187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e3eed-2201-4e01-87a0-254daa8f7712 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:55.151187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783e3eed-2201-4e01-87a0-254daa8f7712 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:55.151187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e3eed-2201-4e01-87a0-254daa8f7712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:55.152936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783e3eed-2201-4e01-87a0-254daa8f7712 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:55.283559 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 918/1830] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:19:55 2021] POST /identity/v3/projects => generated 385 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:55.288257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4632feb-24f0-4138-833c-7e5e17009529 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:55.300857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4632feb-24f0-4138-833c-7e5e17009529 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:55.356207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8c2ae-c552-4c77-b310-fe1f0d56700e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:55.356934 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8c2ae-c552-4c77-b310-fe1f0d56700e admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:55.357981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8c2ae-c552-4c77-b310-fe1f0d56700e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:55.358431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d8c2ae-c552-4c77-b310-fe1f0d56700e admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:55.359513 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8c2ae-c552-4c77-b310-fe1f0d56700e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:55.361713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d8c2ae-c552-4c77-b310-fe1f0d56700e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:55.488522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 913/1831] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:19:55 2021] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:19:55.493009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e3eed-2201-4e01-87a0-254daa8f7712 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:55.502779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783e3eed-2201-4e01-87a0-254daa8f7712 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:55.508567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf71067-2d21-4ee4-8eff-0202895d92ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:55.509275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf71067-2d21-4ee4-8eff-0202895d92ff admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:55.513988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf71067-2d21-4ee4-8eff-0202895d92ff admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:55.513988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf71067-2d21-4ee4-8eff-0202895d92ff admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:55.513988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf71067-2d21-4ee4-8eff-0202895d92ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:55.513988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf71067-2d21-4ee4-8eff-0202895d92ff admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:55.523617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 919/1832] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:55 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:55.527783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8c2ae-c552-4c77-b310-fe1f0d56700e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:55.537583 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d8c2ae-c552-4c77-b310-fe1f0d56700e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:55.542515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab022048-8aa1-4a4a-a20c-45b0e0101376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:55.543484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022048-8aa1-4a4a-a20c-45b0e0101376 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:55.544247 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022048-8aa1-4a4a-a20c-45b0e0101376 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:55.544531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab022048-8aa1-4a4a-a20c-45b0e0101376 admin admin] PATH_INFO: `/v3/projects/62d675a6537a4f4eb41ccaed0840bb13/users/116c6426c73f4d858da860172969f83f/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:55.560564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab022048-8aa1-4a4a-a20c-45b0e0101376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d675a6537a4f4eb41ccaed0840bb13, user_id=116c6426c73f4d858da860172969f83f, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:55.563201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab022048-8aa1-4a4a-a20c-45b0e0101376 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:55.631003 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 914/1833] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:55 2021] PUT /identity/v3/projects/62d675a6537a4f4eb41ccaed0840bb13/users/116c6426c73f4d858da860172969f83f/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:55.635074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf71067-2d21-4ee4-8eff-0202895d92ff admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:55.645137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf71067-2d21-4ee4-8eff-0202895d92ff admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:55.700272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec4dfc-32f4-4676-aa14-fdcde083c874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:55.700929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec4dfc-32f4-4676-aa14-fdcde083c874 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:55.701207 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec4dfc-32f4-4676-aa14-fdcde083c874 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:55.701477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec4dfc-32f4-4676-aa14-fdcde083c874 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:55.702241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec4dfc-32f4-4676-aa14-fdcde083c874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:55.703810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec4dfc-32f4-4676-aa14-fdcde083c874 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:55.713899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 920/1834] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:19:55 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:19:55.717798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab022048-8aa1-4a4a-a20c-45b0e0101376 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:55.728527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab022048-8aa1-4a4a-a20c-45b0e0101376 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:55.733897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638bae4-5258-4e27-bdd8-5af8415674b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:55.734820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638bae4-5258-4e27-bdd8-5af8415674b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:55.735100 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638bae4-5258-4e27-bdd8-5af8415674b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:55.735372 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638bae4-5258-4e27-bdd8-5af8415674b9 admin admin] PATH_INFO: `/v3/projects/62d675a6537a4f4eb41ccaed0840bb13/users/116c6426c73f4d858da860172969f83f/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:55.737367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638bae4-5258-4e27-bdd8-5af8415674b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d675a6537a4f4eb41ccaed0840bb13, user_id=116c6426c73f4d858da860172969f83f, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:55.740337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7638bae4-5258-4e27-bdd8-5af8415674b9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:55.752124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 915/1835] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:19:55 2021] PUT /identity/v3/projects/62d675a6537a4f4eb41ccaed0840bb13/users/116c6426c73f4d858da860172969f83f/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:19:55.764221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b064b-3898-4327-9ba2-bbf302d826cd None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:55.764644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b064b-3898-4327-9ba2-bbf302d826cd None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:55.764928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713b064b-3898-4327-9ba2-bbf302d826cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:55.793555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-713b064b-3898-4327-9ba2-bbf302d826cd None None] MFA Rules not processed for user `116c6426c73f4d858da860172969f83f`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:19:55.794831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-713b064b-3898-4327-9ba2-bbf302d826cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:19:55.870251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 921/1836] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:19:55 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:19:55.881402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638bae4-5258-4e27-bdd8-5af8415674b9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:55.935151 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638bae4-5258-4e27-bdd8-5af8415674b9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:55.939900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaaf9c-2a16-4e50-ade4-cb7eac246d79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:55.940577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaaf9c-2a16-4e50-ade4-cb7eac246d79 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:55.940852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaaf9c-2a16-4e50-ade4-cb7eac246d79 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:55.941120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aaaf9c-2a16-4e50-ade4-cb7eac246d79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:55.955085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aaaf9c-2a16-4e50-ade4-cb7eac246d79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:55.956605 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aaaf9c-2a16-4e50-ade4-cb7eac246d79 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:55.968483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 916/1837] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:55 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:19:56.992646 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b064b-3898-4327-9ba2-bbf302d826cd None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:19:57.005476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713b064b-3898-4327-9ba2-bbf302d826cd None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:19:57.009309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5bcab-6574-4f97-a822-b02520dfb88c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:19:57.010179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5bcab-6574-4f97-a822-b02520dfb88c service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:19:57.010639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5bcab-6574-4f97-a822-b02520dfb88c service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:19:57.010914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d5bcab-6574-4f97-a822-b02520dfb88c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:19:57.085291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5bcab-6574-4f97-a822-b02520dfb88c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:19:57.086771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d5bcab-6574-4f97-a822-b02520dfb88c service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:19:57.096963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 922/1838] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:19:56 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:08.423787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaaf9c-2a16-4e50-ade4-cb7eac246d79 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:08.437028 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aaaf9c-2a16-4e50-ade4-cb7eac246d79 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:08.455645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aab1d0d-f2ec-4397-85dd-594debbfcd9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:08.456305 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1d0d-f2ec-4397-85dd-594debbfcd9f service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:08.456576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1d0d-f2ec-4397-85dd-594debbfcd9f service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:08.458427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aab1d0d-f2ec-4397-85dd-594debbfcd9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:08.547868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab1d0d-f2ec-4397-85dd-594debbfcd9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:08.548864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aab1d0d-f2ec-4397-85dd-594debbfcd9f service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:08.559950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 917/1839] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:08 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:09.387332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5bcab-6574-4f97-a822-b02520dfb88c service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:09.500089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d5bcab-6574-4f97-a822-b02520dfb88c service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:09.510841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:09.515201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:09.515492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:09.515770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] PATH_INFO: `/v3/users/e844c830eb664c24ae4b950324026ad4` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:09.517069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e844c830eb664c24ae4b950324026ad4)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:09.519313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:09.760914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e844c830eb664c24ae4b950324026ad4'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:09.782567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e844c830eb664c24ae4b950324026ad4'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:09.794129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e844c830eb664c24ae4b950324026ad4'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:09.911480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e844c830eb664c24ae4b950324026ad4'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:09.913585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e844c830eb664c24ae4b950324026ad4'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:09.926297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 923/1840] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:09 2021] DELETE /identity/v3/users/e844c830eb664c24ae4b950324026ad4 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:09.927854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b05c96-0c0f-4113-87c6-3c08e1839363 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:09.928379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b05c96-0c0f-4113-87c6-3c08e1839363 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:09.928379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b05c96-0c0f-4113-87c6-3c08e1839363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:09.946718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c7b05c96-0c0f-4113-87c6-3c08e1839363 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:09.947934 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c7b05c96-0c0f-4113-87c6-3c08e1839363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:10.038198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 918/1841] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:10.044021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:10.047152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:10.068138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b05c96-0c0f-4113-87c6-3c08e1839363 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:10.071466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c7b05c96-0c0f-4113-87c6-3c08e1839363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:10.089682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b05c96-0c0f-4113-87c6-3c08e1839363 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:10.096174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:10.097142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:10.097608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:10.097709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] PATH_INFO: `/v3/users/f512df00f104463cb3ffc495584995ce` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:10.103414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f512df00f104463cb3ffc495584995ce)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:10.103414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:10.147796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4210f7-058b-41ad-8e12-83d350094f74 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:10.155010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758c6ef-0582-4307-95a6-4a2de63fc1f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:10.155010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758c6ef-0582-4307-95a6-4a2de63fc1f8 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:10.155010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758c6ef-0582-4307-95a6-4a2de63fc1f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:10.155010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758c6ef-0582-4307-95a6-4a2de63fc1f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:10.165731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758c6ef-0582-4307-95a6-4a2de63fc1f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:10.167294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e758c6ef-0582-4307-95a6-4a2de63fc1f8 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:10.180352 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 924/1842] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:10.282551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f512df00f104463cb3ffc495584995ce'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:10.300917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f512df00f104463cb3ffc495584995ce'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:10.308485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f512df00f104463cb3ffc495584995ce'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:10.315708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f512df00f104463cb3ffc495584995ce'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:10.418997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f512df00f104463cb3ffc495584995ce'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:10.425553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 919/1843] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:10 2021] DELETE /identity/v3/users/f512df00f104463cb3ffc495584995ce => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:10.432031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92b1ae-26e0-483a-8f61-5355c594f5e7 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:10.432554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92b1ae-26e0-483a-8f61-5355c594f5e7 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:10.434160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee92b1ae-26e0-483a-8f61-5355c594f5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:10.475251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ee92b1ae-26e0-483a-8f61-5355c594f5e7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:10.476632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ee92b1ae-26e0-483a-8f61-5355c594f5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:10.612312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 925/1844] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:10.627736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:10.629583 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:10.744682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2657aed-7c81-4676-a4e4-3193ad924c89 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:10.750535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade934e9-b7ef-44c4-955b-899b6cc38847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:10.751328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade934e9-b7ef-44c4-955b-899b6cc38847 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:10.751726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade934e9-b7ef-44c4-955b-899b6cc38847 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:10.752188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade934e9-b7ef-44c4-955b-899b6cc38847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:10.763633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade934e9-b7ef-44c4-955b-899b6cc38847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:10.771084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade934e9-b7ef-44c4-955b-899b6cc38847 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:10.776755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 920/1845] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:10.802760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92b1ae-26e0-483a-8f61-5355c594f5e7 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:10.804217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ee92b1ae-26e0-483a-8f61-5355c594f5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:10.825969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee92b1ae-26e0-483a-8f61-5355c594f5e7 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:10.835974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:10.837338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:10.838224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:10.838864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] PATH_INFO: `/v3/projects/24ca2b99a51d4e7db42d5b6cbf9403eb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:10.840346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24ca2b99a51d4e7db42d5b6cbf9403eb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:10.851795 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:11.012222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24ca2b99a51d4e7db42d5b6cbf9403eb', 'request_id': 'req-08ed6dc1-ec47-4d84-8530-7479c925a808'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.021950 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24ca2b99a51d4e7db42d5b6cbf9403eb', 'request_id': 'req-08ed6dc1-ec47-4d84-8530-7479c925a808'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.030516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24ca2b99a51d4e7db42d5b6cbf9403eb', 'request_id': 'req-08ed6dc1-ec47-4d84-8530-7479c925a808'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.117472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] The token cache is being invalidate because project 24ca2b99a51d4e7db42d5b6cbf9403eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:11.117784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.119050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.121737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 926/1846] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:10 2021] DELETE /identity/v3/projects/24ca2b99a51d4e7db42d5b6cbf9403eb => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:11.126400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade934e9-b7ef-44c4-955b-899b6cc38847 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:11.142750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade934e9-b7ef-44c4-955b-899b6cc38847 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:11.233631 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:11.234692 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:11.236163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:11.236163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] PATH_INFO: `/v3/users/fa6df754413c4cfa9e41baa54d0ff499` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:11.237833 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa6df754413c4cfa9e41baa54d0ff499)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:11.240547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:11.387240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:11.389182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:11.409892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed6dc1-ec47-4d84-8530-7479c925a808 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:11.421715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:11.422641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:11.423060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:11.423319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] PATH_INFO: `/v3/projects/079975aac79e4b3fba8c6ca5aa4caf2e` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:11.424673 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=079975aac79e4b3fba8c6ca5aa4caf2e)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:11.426620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:11.460894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa6df754413c4cfa9e41baa54d0ff499'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.476081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa6df754413c4cfa9e41baa54d0ff499'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.483564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa6df754413c4cfa9e41baa54d0ff499'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.484421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa6df754413c4cfa9e41baa54d0ff499'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.517634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '079975aac79e4b3fba8c6ca5aa4caf2e', 'request_id': 'req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.524197 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '079975aac79e4b3fba8c6ca5aa4caf2e', 'request_id': 'req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.530267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '079975aac79e4b3fba8c6ca5aa4caf2e', 'request_id': 'req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.550718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa6df754413c4cfa9e41baa54d0ff499'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.558609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 921/1847] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:11 2021] DELETE /identity/v3/users/fa6df754413c4cfa9e41baa54d0ff499 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:11.597098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] The token cache is being invalidate because project 079975aac79e4b3fba8c6ca5aa4caf2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:11.597638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.598509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.604142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 927/1848] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:11 2021] DELETE /identity/v3/projects/079975aac79e4b3fba8c6ca5aa4caf2e => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:11.605333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:11.607048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:11.676028 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f26c4-3870-4f9f-9dc5-687bd4b92522 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:11.681143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:11.682128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:11.682408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:11.682795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] PATH_INFO: `/v3/users/02a3b30413a640fa9407209db732d0d0` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:11.683999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a3b30413a640fa9407209db732d0d0)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:11.685886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:11.878101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a3b30413a640fa9407209db732d0d0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.890745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a3b30413a640fa9407209db732d0d0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.897639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a3b30413a640fa9407209db732d0d0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.898429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a3b30413a640fa9407209db732d0d0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.972960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a3b30413a640fa9407209db732d0d0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:11.980792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 922/1849] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:11 2021] DELETE /identity/v3/users/02a3b30413a640fa9407209db732d0d0 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:12.006113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.008791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.123138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f63e2-8fb9-492a-8768-fa6d3c7415b2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.179226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.180088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.180966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.181314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] PATH_INFO: `/v3/projects/1f7a6ec3c49b467db1d679fd06ce0bf1` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.182597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f7a6ec3c49b467db1d679fd06ce0bf1)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.184899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.309688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f7a6ec3c49b467db1d679fd06ce0bf1', 'request_id': 'req-fed48260-374a-4907-8c9a-0508f2de8746'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.316846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f7a6ec3c49b467db1d679fd06ce0bf1', 'request_id': 'req-fed48260-374a-4907-8c9a-0508f2de8746'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.324798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f7a6ec3c49b467db1d679fd06ce0bf1', 'request_id': 'req-fed48260-374a-4907-8c9a-0508f2de8746'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.433007 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.435707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.442662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] The token cache is being invalidate because project 1f7a6ec3c49b467db1d679fd06ce0bf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:12.442954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.444497 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fed48260-374a-4907-8c9a-0508f2de8746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.449216 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 928/1850] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:12 2021] DELETE /identity/v3/projects/1f7a6ec3c49b467db1d679fd06ce0bf1 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:12.458286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803e33d-1139-4883-9293-0e4666fb6a50 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.461182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe7d6-3920-4445-b158-3fb52341d046 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.462130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe7d6-3920-4445-b158-3fb52341d046 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.462491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9abe7d6-3920-4445-b158-3fb52341d046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.495288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d9abe7d6-3920-4445-b158-3fb52341d046 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:12.496574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d9abe7d6-3920-4445-b158-3fb52341d046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.531799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.532654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.532933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.533211 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] PATH_INFO: `/v3/projects/511c06534b7f49a194c6d8db7fb7bb20` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.534440 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] RBAC: Authorizing `identity:delete_project(project_id=511c06534b7f49a194c6d8db7fb7bb20)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.536340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.554684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 929/1851] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:12.563159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d822fe-fab1-4514-a0cd-b2e3c1d21398 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.563450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d822fe-fab1-4514-a0cd-b2e3c1d21398 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.563693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d822fe-fab1-4514-a0cd-b2e3c1d21398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.582597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d0d822fe-fab1-4514-a0cd-b2e3c1d21398 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:12.583798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d0d822fe-fab1-4514-a0cd-b2e3c1d21398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.592414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 930/1852] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:12.601141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d822fe-fab1-4514-a0cd-b2e3c1d21398 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.607534 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d822fe-fab1-4514-a0cd-b2e3c1d21398 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.612382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52139d87-13ab-4233-a60c-b56f849205de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.613045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52139d87-13ab-4233-a60c-b56f849205de admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.613321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52139d87-13ab-4233-a60c-b56f849205de admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.613589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52139d87-13ab-4233-a60c-b56f849205de admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.614350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52139d87-13ab-4233-a60c-b56f849205de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:12.614650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52139d87-13ab-4233-a60c-b56f849205de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.616240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52139d87-13ab-4233-a60c-b56f849205de admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.631256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 931/1853] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:12.633238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52139d87-13ab-4233-a60c-b56f849205de admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.634165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511c06534b7f49a194c6d8db7fb7bb20', 'request_id': 'req-82537b81-2662-4401-955e-6e4d34d1d64a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.645175 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52139d87-13ab-4233-a60c-b56f849205de admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.666680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511c06534b7f49a194c6d8db7fb7bb20', 'request_id': 'req-82537b81-2662-4401-955e-6e4d34d1d64a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.672846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511c06534b7f49a194c6d8db7fb7bb20', 'request_id': 'req-82537b81-2662-4401-955e-6e4d34d1d64a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.728804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedc95c-9103-45b2-a8a8-6f0dc1169511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.729471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedc95c-9103-45b2-a8a8-6f0dc1169511 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.729868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedc95c-9103-45b2-a8a8-6f0dc1169511 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.730012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bedc95c-9103-45b2-a8a8-6f0dc1169511 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.730922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedc95c-9103-45b2-a8a8-6f0dc1169511 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.733476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bedc95c-9103-45b2-a8a8-6f0dc1169511 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.749972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] The token cache is being invalidate because project 511c06534b7f49a194c6d8db7fb7bb20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:12.750168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.751213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-82537b81-2662-4401-955e-6e4d34d1d64a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:12.753882 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 923/1854] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:12 2021] DELETE /identity/v3/projects/511c06534b7f49a194c6d8db7fb7bb20 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:12.759738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6598-14f5-406d-87a7-0fbaa61935ee None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.760093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6598-14f5-406d-87a7-0fbaa61935ee None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.760450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6598-14f5-406d-87a7-0fbaa61935ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.778432 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-a2be6598-14f5-406d-87a7-0fbaa61935ee None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:12.779616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a2be6598-14f5-406d-87a7-0fbaa61935ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.787275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 924/1855] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:12.795286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc559be-1dc5-46ac-85cd-30051915d241 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.795565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc559be-1dc5-46ac-85cd-30051915d241 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.795832 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc559be-1dc5-46ac-85cd-30051915d241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.813993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-4cc559be-1dc5-46ac-85cd-30051915d241 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:12.815245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4cc559be-1dc5-46ac-85cd-30051915d241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.823621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 925/1856] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:12.827558 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc559be-1dc5-46ac-85cd-30051915d241 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.836262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc559be-1dc5-46ac-85cd-30051915d241 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.841044 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f551-a064-48fc-9d72-99041e0ffa08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.841665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f551-a064-48fc-9d72-99041e0ffa08 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.841943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f551-a064-48fc-9d72-99041e0ffa08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.842245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037f551-a064-48fc-9d72-99041e0ffa08 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.842995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f551-a064-48fc-9d72-99041e0ffa08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:12.843408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f551-a064-48fc-9d72-99041e0ffa08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.845016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037f551-a064-48fc-9d72-99041e0ffa08 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.857545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 926/1857] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:12 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:12.865205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f551-a064-48fc-9d72-99041e0ffa08 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.875803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037f551-a064-48fc-9d72-99041e0ffa08 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.882149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce69710-7d8f-4b06-8902-5b74693aed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.883029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce69710-7d8f-4b06-8902-5b74693aed5d admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.884032 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce69710-7d8f-4b06-8902-5b74693aed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.884473 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce69710-7d8f-4b06-8902-5b74693aed5d admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.885237 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce69710-7d8f-4b06-8902-5b74693aed5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.888421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce69710-7d8f-4b06-8902-5b74693aed5d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:12.892246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 932/1858] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:12 2021] POST /identity/v3/projects => generated 373 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:12.896045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedc95c-9103-45b2-a8a8-6f0dc1169511 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:12.897747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3bedc95c-9103-45b2-a8a8-6f0dc1169511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:12.960348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bedc95c-9103-45b2-a8a8-6f0dc1169511 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:12.971675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303869c4-e690-4b52-8f66-51fb01a82cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:12.971675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303869c4-e690-4b52-8f66-51fb01a82cc3 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:12.971675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303869c4-e690-4b52-8f66-51fb01a82cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:12.971675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303869c4-e690-4b52-8f66-51fb01a82cc3 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:12.972018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303869c4-e690-4b52-8f66-51fb01a82cc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:12.972018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303869c4-e690-4b52-8f66-51fb01a82cc3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.006493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 927/1859] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:12 2021] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:13.008989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce69710-7d8f-4b06-8902-5b74693aed5d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.067661 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce69710-7d8f-4b06-8902-5b74693aed5d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.070612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 933/1860] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:12 2021] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:13.075134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303869c4-e690-4b52-8f66-51fb01a82cc3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.075938 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d319b-c385-48a2-a4db-c47972535605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.076614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d319b-c385-48a2-a4db-c47972535605 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.076917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d319b-c385-48a2-a4db-c47972535605 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.077248 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8d319b-c385-48a2-a4db-c47972535605 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.078501 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d319b-c385-48a2-a4db-c47972535605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.079946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8d319b-c385-48a2-a4db-c47972535605 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.099213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303869c4-e690-4b52-8f66-51fb01a82cc3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.105293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2988-fd50-440f-8a9a-f904a3167cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.105972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2988-fd50-440f-8a9a-f904a3167cdf admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.106280 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2988-fd50-440f-8a9a-f904a3167cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.106557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a2988-fd50-440f-8a9a-f904a3167cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.107308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a2988-fd50-440f-8a9a-f904a3167cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.109249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a2988-fd50-440f-8a9a-f904a3167cdf admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.121230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 934/1861] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:13 2021] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:13.125074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2988-fd50-440f-8a9a-f904a3167cdf admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.134951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a2988-fd50-440f-8a9a-f904a3167cdf admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.139648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340256b-7151-4065-bb12-94c9adf70e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.149492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340256b-7151-4065-bb12-94c9adf70e5b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.149492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340256b-7151-4065-bb12-94c9adf70e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.149492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c340256b-7151-4065-bb12-94c9adf70e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.149492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340256b-7151-4065-bb12-94c9adf70e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.149492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c340256b-7151-4065-bb12-94c9adf70e5b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.153535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 935/1862] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:13.157389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340256b-7151-4065-bb12-94c9adf70e5b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.167928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c340256b-7151-4065-bb12-94c9adf70e5b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.172976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9ca49d-44b3-49a6-a35a-b20b531a3552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.173844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ca49d-44b3-49a6-a35a-b20b531a3552 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.174152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ca49d-44b3-49a6-a35a-b20b531a3552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.174426 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9ca49d-44b3-49a6-a35a-b20b531a3552 admin admin] PATH_INFO: `/v3/projects/5a98d44995884c4dad1145265bcb4d51/users/292ae09c1e6045fd91c3086efaaa3a5b/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.184445 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 928/1863] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:13 2021] POST /identity/v3/users => generated 294 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:13.188451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d319b-c385-48a2-a4db-c47972535605 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.189858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ca49d-44b3-49a6-a35a-b20b531a3552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a98d44995884c4dad1145265bcb4d51, user_id=292ae09c1e6045fd91c3086efaaa3a5b, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.192480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9ca49d-44b3-49a6-a35a-b20b531a3552 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.199364 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8d319b-c385-48a2-a4db-c47972535605 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.204178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78305c-6050-4cd4-ae6f-15197d10c256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.206417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78305c-6050-4cd4-ae6f-15197d10c256 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.206417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78305c-6050-4cd4-ae6f-15197d10c256 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.206417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78305c-6050-4cd4-ae6f-15197d10c256 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.206417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78305c-6050-4cd4-ae6f-15197d10c256 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.207698 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78305c-6050-4cd4-ae6f-15197d10c256 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.219127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 929/1864] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:13 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:13.222904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78305c-6050-4cd4-ae6f-15197d10c256 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.233493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78305c-6050-4cd4-ae6f-15197d10c256 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.238331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d968dc5-953d-4c0b-b12a-c1f1622a8962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.238978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d968dc5-953d-4c0b-b12a-c1f1622a8962 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.239331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d968dc5-953d-4c0b-b12a-c1f1622a8962 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.239606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d968dc5-953d-4c0b-b12a-c1f1622a8962 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.240441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d968dc5-953d-4c0b-b12a-c1f1622a8962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.242274 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d968dc5-953d-4c0b-b12a-c1f1622a8962 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.249756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 936/1865] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:13 2021] PUT /identity/v3/projects/5a98d44995884c4dad1145265bcb4d51/users/292ae09c1e6045fd91c3086efaaa3a5b/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:13.258880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 930/1866] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:13 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:13.259611 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d968dc5-953d-4c0b-b12a-c1f1622a8962 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.260158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf097-5a10-453d-aaca-f1840a376d3e None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.260446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf097-5a10-453d-aaca-f1840a376d3e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.260718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf097-5a10-453d-aaca-f1840a376d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.269696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d968dc5-953d-4c0b-b12a-c1f1622a8962 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.288717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ff8bf097-5a10-453d-aaca-f1840a376d3e None None] MFA Rules not processed for user `292ae09c1e6045fd91c3086efaaa3a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:13.290653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ff8bf097-5a10-453d-aaca-f1840a376d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.346624 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1dac1-5324-46f6-85d0-dd16fb96e7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.352767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1dac1-5324-46f6-85d0-dd16fb96e7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.352767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1dac1-5324-46f6-85d0-dd16fb96e7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.352767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1dac1-5324-46f6-85d0-dd16fb96e7ad admin admin] PATH_INFO: `/v3/projects/644419e9f4ff44248a448ac113de7d1e/users/acf96142186449839804dd057ebb0e76/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.366751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1dac1-5324-46f6-85d0-dd16fb96e7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=644419e9f4ff44248a448ac113de7d1e, user_id=acf96142186449839804dd057ebb0e76, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.371181 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1dac1-5324-46f6-85d0-dd16fb96e7ad admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.379934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 937/1867] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:13 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:13.390266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf097-5a10-453d-aaca-f1840a376d3e None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.391785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ff8bf097-5a10-453d-aaca-f1840a376d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.446900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf097-5a10-453d-aaca-f1840a376d3e None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.450475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720f44d-e0d2-4359-89bc-c3f248b8d6e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.451144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720f44d-e0d2-4359-89bc-c3f248b8d6e2 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.451425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720f44d-e0d2-4359-89bc-c3f248b8d6e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.451700 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720f44d-e0d2-4359-89bc-c3f248b8d6e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.459749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720f44d-e0d2-4359-89bc-c3f248b8d6e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.461165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720f44d-e0d2-4359-89bc-c3f248b8d6e2 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.470966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 938/1868] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:13 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:13.473977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720f44d-e0d2-4359-89bc-c3f248b8d6e2 service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.473977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1720f44d-e0d2-4359-89bc-c3f248b8d6e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.491653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720f44d-e0d2-4359-89bc-c3f248b8d6e2 service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.498976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.499851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.500132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.500536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] PATH_INFO: `/v3/users/80c36dfdc202476faba0853207a0b9f1` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.501793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80c36dfdc202476faba0853207a0b9f1)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.503784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.533858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 931/1869] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:13 2021] PUT /identity/v3/projects/644419e9f4ff44248a448ac113de7d1e/users/acf96142186449839804dd057ebb0e76/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:13.537829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1dac1-5324-46f6-85d0-dd16fb96e7ad admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.598114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1dac1-5324-46f6-85d0-dd16fb96e7ad admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:13.603757 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:13.604623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.604953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.605228 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] PATH_INFO: `/v3/users/292ae09c1e6045fd91c3086efaaa3a5b` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.606500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=292ae09c1e6045fd91c3086efaaa3a5b)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:13.608653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:13.764975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80c36dfdc202476faba0853207a0b9f1'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.777838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80c36dfdc202476faba0853207a0b9f1'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.784648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80c36dfdc202476faba0853207a0b9f1'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.810716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '292ae09c1e6045fd91c3086efaaa3a5b'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.823222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '292ae09c1e6045fd91c3086efaaa3a5b'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.829926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '292ae09c1e6045fd91c3086efaaa3a5b'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.831647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '292ae09c1e6045fd91c3086efaaa3a5b'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.841568 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80c36dfdc202476faba0853207a0b9f1'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.842253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3de29766-518e-4ec7-8f84-6b4036f727f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80c36dfdc202476faba0853207a0b9f1'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.848566 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 939/1870] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:13 2021] DELETE /identity/v3/users/80c36dfdc202476faba0853207a0b9f1 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:13.850003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b016d-1768-4e32-9ac7-6348d4e2d0c0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.850330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b016d-1768-4e32-9ac7-6348d4e2d0c0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.850603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b016d-1768-4e32-9ac7-6348d4e2d0c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.876194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b81b016d-1768-4e32-9ac7-6348d4e2d0c0 None None] MFA Rules not processed for user `acf96142186449839804dd057ebb0e76`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:13.877380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b81b016d-1768-4e32-9ac7-6348d4e2d0c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.898549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c903fae4-2eaf-4968-a583-e51609de8588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '292ae09c1e6045fd91c3086efaaa3a5b'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:13.905198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 932/1871] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:13 2021] DELETE /identity/v3/users/292ae09c1e6045fd91c3086efaaa3a5b => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:13.906666 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7111619-4181-41cc-8a48-080f1001d6c7 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.906952 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7111619-4181-41cc-8a48-080f1001d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.907225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7111619-4181-41cc-8a48-080f1001d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.924189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c7111619-4181-41cc-8a48-080f1001d6c7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:13.925382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c7111619-4181-41cc-8a48-080f1001d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.942307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 940/1872] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:13 2021] POST /identity/v3/auth/tokens => generated 3407 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:13.943644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf67ec6-c02b-4edc-96dd-3f052501b397 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:13.943935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf67ec6-c02b-4edc-96dd-3f052501b397 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:13.944215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf67ec6-c02b-4edc-96dd-3f052501b397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:13.962912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-bbf67ec6-c02b-4edc-96dd-3f052501b397 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:13.964021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bbf67ec6-c02b-4edc-96dd-3f052501b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:13.989857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 933/1873] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:13.991039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7111619-4181-41cc-8a48-080f1001d6c7 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:13.992464 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c7111619-4181-41cc-8a48-080f1001d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:14.006683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7111619-4181-41cc-8a48-080f1001d6c7 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.010835 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8218b4f-0c92-4d32-9242-96acad48c97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.011498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218b4f-0c92-4d32-9242-96acad48c97d admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.011846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218b4f-0c92-4d32-9242-96acad48c97d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.012079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8218b4f-0c92-4d32-9242-96acad48c97d admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.012779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8218b4f-0c92-4d32-9242-96acad48c97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.014682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8218b4f-0c92-4d32-9242-96acad48c97d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.025992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 941/1874] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:14.027121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf67ec6-c02b-4edc-96dd-3f052501b397 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.028553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bbf67ec6-c02b-4edc-96dd-3f052501b397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:14.099449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 934/1875] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:13 2021] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:14.099449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8218b4f-0c92-4d32-9242-96acad48c97d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.104431 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf67ec6-c02b-4edc-96dd-3f052501b397 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.157353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d74794-8d2a-4db0-924f-747834cd94e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.158007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d74794-8d2a-4db0-924f-747834cd94e2 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.158322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d74794-8d2a-4db0-924f-747834cd94e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.158600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d74794-8d2a-4db0-924f-747834cd94e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.158870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8218b4f-0c92-4d32-9242-96acad48c97d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.163258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027991f-469a-422d-86bd-25ae84a2f83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.163910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027991f-469a-422d-86bd-25ae84a2f83f service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.164199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027991f-469a-422d-86bd-25ae84a2f83f service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.164489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027991f-469a-422d-86bd-25ae84a2f83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.221562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d74794-8d2a-4db0-924f-747834cd94e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.223017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d74794-8d2a-4db0-924f-747834cd94e2 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.234284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027991f-469a-422d-86bd-25ae84a2f83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.235745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027991f-469a-422d-86bd-25ae84a2f83f service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.240696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 942/1876] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:14.241669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d74794-8d2a-4db0-924f-747834cd94e2 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.250260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 935/1877] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:14.266423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d74794-8d2a-4db0-924f-747834cd94e2 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.272259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de456ef1-6d4b-4441-9e37-700903b8eb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.273027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456ef1-6d4b-4441-9e37-700903b8eb17 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.273399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456ef1-6d4b-4441-9e37-700903b8eb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.273812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de456ef1-6d4b-4441-9e37-700903b8eb17 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.274654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de456ef1-6d4b-4441-9e37-700903b8eb17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.276914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de456ef1-6d4b-4441-9e37-700903b8eb17 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.431600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 943/1878] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:14 2021] POST /identity/v3/users => generated 300 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:14.435782 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027991f-469a-422d-86bd-25ae84a2f83f service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.446303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027991f-469a-422d-86bd-25ae84a2f83f service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.451819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04f56-f5f1-4e73-b456-4f10ad49da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.452476 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04f56-f5f1-4e73-b456-4f10ad49da5d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.452748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04f56-f5f1-4e73-b456-4f10ad49da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.453016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa04f56-f5f1-4e73-b456-4f10ad49da5d admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.453745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04f56-f5f1-4e73-b456-4f10ad49da5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.455539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa04f56-f5f1-4e73-b456-4f10ad49da5d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.473228 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 936/1879] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:14.474490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de456ef1-6d4b-4441-9e37-700903b8eb17 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.485399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de456ef1-6d4b-4441-9e37-700903b8eb17 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.490189 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cc7c0-cf7d-43db-b8a9-a0fb7e413ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.491131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cc7c0-cf7d-43db-b8a9-a0fb7e413ef9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.491419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cc7c0-cf7d-43db-b8a9-a0fb7e413ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.491691 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87cc7c0-cf7d-43db-b8a9-a0fb7e413ef9 admin admin] PATH_INFO: `/v3/projects/f0530bda7fd4412eb042e98e827ff094/users/16a54cb1df4b4b64b84435e5afc9017f/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.507186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cc7c0-cf7d-43db-b8a9-a0fb7e413ef9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0530bda7fd4412eb042e98e827ff094, user_id=16a54cb1df4b4b64b84435e5afc9017f, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.510575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87cc7c0-cf7d-43db-b8a9-a0fb7e413ef9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.614586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 944/1880] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:14 2021] PUT /identity/v3/projects/f0530bda7fd4412eb042e98e827ff094/users/16a54cb1df4b4b64b84435e5afc9017f/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:14.619552 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04f56-f5f1-4e73-b456-4f10ad49da5d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.636199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa04f56-f5f1-4e73-b456-4f10ad49da5d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.721981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde423d2-fc6d-462a-9c56-fef3cac3b0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.722847 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde423d2-fc6d-462a-9c56-fef3cac3b0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.723133 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde423d2-fc6d-462a-9c56-fef3cac3b0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.723463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde423d2-fc6d-462a-9c56-fef3cac3b0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.724162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde423d2-fc6d-462a-9c56-fef3cac3b0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.725960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde423d2-fc6d-462a-9c56-fef3cac3b0d8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.741920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cc7c0-cf7d-43db-b8a9-a0fb7e413ef9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.747823 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 937/1881] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:14 2021] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:14.753058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87cc7c0-cf7d-43db-b8a9-a0fb7e413ef9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.758130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67c245-7266-47d0-bee4-55f53c37d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.759636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67c245-7266-47d0-bee4-55f53c37d0b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.760133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67c245-7266-47d0-bee4-55f53c37d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.760693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67c245-7266-47d0-bee4-55f53c37d0b2 admin admin] PATH_INFO: `/v3/projects/f0530bda7fd4412eb042e98e827ff094/users/16a54cb1df4b4b64b84435e5afc9017f/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.778203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67c245-7266-47d0-bee4-55f53c37d0b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0530bda7fd4412eb042e98e827ff094, user_id=16a54cb1df4b4b64b84435e5afc9017f, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.780777 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67c245-7266-47d0-bee4-55f53c37d0b2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.811158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 945/1882] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:14 2021] PUT /identity/v3/projects/f0530bda7fd4412eb042e98e827ff094/users/16a54cb1df4b4b64b84435e5afc9017f/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:14.815288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde423d2-fc6d-462a-9c56-fef3cac3b0d8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.817049 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dde423d2-fc6d-462a-9c56-fef3cac3b0d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:14.821844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574e980-8397-4d49-829b-ee2d7d00bc6e None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.822500 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574e980-8397-4d49-829b-ee2d7d00bc6e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.822985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0574e980-8397-4d49-829b-ee2d7d00bc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.835387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde423d2-fc6d-462a-9c56-fef3cac3b0d8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:14.883558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-0574e980-8397-4d49-829b-ee2d7d00bc6e None None] MFA Rules not processed for user `16a54cb1df4b4b64b84435e5afc9017f`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:14.885840 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0574e980-8397-4d49-829b-ee2d7d00bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:14.923700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:14.924553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:14.924827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:14.925094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] PATH_INFO: `/v3/projects/26523e2efcc447baae51c2b84ddcaaf4` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:14.926650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=26523e2efcc447baae51c2b84ddcaaf4)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:14.928517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:14.961052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 946/1883] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:14 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:14.972042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574e980-8397-4d49-829b-ee2d7d00bc6e None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:14.973602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0574e980-8397-4d49-829b-ee2d7d00bc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:15.038642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26523e2efcc447baae51c2b84ddcaaf4', 'request_id': 'req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.042057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0574e980-8397-4d49-829b-ee2d7d00bc6e None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.046855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26523e2efcc447baae51c2b84ddcaaf4', 'request_id': 'req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.052452 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26523e2efcc447baae51c2b84ddcaaf4', 'request_id': 'req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.092033 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57887-d11b-43aa-a1ab-51756931412a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.092775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57887-d11b-43aa-a1ab-51756931412a service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.093145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57887-d11b-43aa-a1ab-51756931412a service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.093481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b57887-d11b-43aa-a1ab-51756931412a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.121939 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] The token cache is being invalidate because project 26523e2efcc447baae51c2b84ddcaaf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:15.122392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.123037 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.127658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 938/1884] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:14 2021] DELETE /identity/v3/projects/26523e2efcc447baae51c2b84ddcaaf4 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:15.127658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:15.127658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:15.159518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57887-d11b-43aa-a1ab-51756931412a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:15.161018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b57887-d11b-43aa-a1ab-51756931412a service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:15.171018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 947/1885] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:14 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:15.171850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57887-d11b-43aa-a1ab-51756931412a service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:15.198907 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee6c36-546f-49dd-a111-1f1f2ed52a0a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.203717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.204564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.204838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.205110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] PATH_INFO: `/v3/projects/5a98d44995884c4dad1145265bcb4d51` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.206394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a98d44995884c4dad1145265bcb4d51)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:15.208297 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:15.231807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b57887-d11b-43aa-a1ab-51756931412a service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.236669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.237532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.237811 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.238114 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] PATH_INFO: `/v3/users/e20fce0202ac424e8e19c1c4d5418dd6` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.239335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20fce0202ac424e8e19c1c4d5418dd6)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:15.243607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:15.323340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a98d44995884c4dad1145265bcb4d51', 'request_id': 'req-92222398-ce29-430e-9f83-f8825d3cd6b5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.330292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a98d44995884c4dad1145265bcb4d51', 'request_id': 'req-92222398-ce29-430e-9f83-f8825d3cd6b5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.336158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a98d44995884c4dad1145265bcb4d51', 'request_id': 'req-92222398-ce29-430e-9f83-f8825d3cd6b5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.415006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20fce0202ac424e8e19c1c4d5418dd6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.419570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] The token cache is being invalidate because project 5a98d44995884c4dad1145265bcb4d51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:15.419851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.422235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-92222398-ce29-430e-9f83-f8825d3cd6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.429650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 939/1886] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:15 2021] DELETE /identity/v3/projects/5a98d44995884c4dad1145265bcb4d51 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:15.431689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20fce0202ac424e8e19c1c4d5418dd6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.435945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac387c2-5b3f-4a27-8e27-08aafdd6e3b3 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.436386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac387c2-5b3f-4a27-8e27-08aafdd6e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.436890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac387c2-5b3f-4a27-8e27-08aafdd6e3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.440271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20fce0202ac424e8e19c1c4d5418dd6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.464228 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-dac387c2-5b3f-4a27-8e27-08aafdd6e3b3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:15.465450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dac387c2-5b3f-4a27-8e27-08aafdd6e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:15.524676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 940/1887] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:15.527011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20fce0202ac424e8e19c1c4d5418dd6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.527625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20fce0202ac424e8e19c1c4d5418dd6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:15.532394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd16ac-7ed8-4ff7-863d-c8e62d187295 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.532684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd16ac-7ed8-4ff7-863d-c8e62d187295 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.532952 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd16ac-7ed8-4ff7-863d-c8e62d187295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.533826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 948/1888] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:15 2021] DELETE /identity/v3/users/e20fce0202ac424e8e19c1c4d5418dd6 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:15.551918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2ecd16ac-7ed8-4ff7-863d-c8e62d187295 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:15.553132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2ecd16ac-7ed8-4ff7-863d-c8e62d187295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:15.621456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 941/1889] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:15.622728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:15.632902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6423af94-c5bb-44b5-b709-3b071823bd1e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.638964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec4c08-f308-4547-9928-2828b9b4bc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.639622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4c08-f308-4547-9928-2828b9b4bc15 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.639899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4c08-f308-4547-9928-2828b9b4bc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.641900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec4c08-f308-4547-9928-2828b9b4bc15 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.641900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec4c08-f308-4547-9928-2828b9b4bc15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:15.641900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec4c08-f308-4547-9928-2828b9b4bc15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:15.642775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec4c08-f308-4547-9928-2828b9b4bc15 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:15.654133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 949/1890] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:15.659077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd16ac-7ed8-4ff7-863d-c8e62d187295 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:15.668352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd16ac-7ed8-4ff7-863d-c8e62d187295 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.672964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d5f5-83ec-4f01-a645-bc12cab4c1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.673602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d5f5-83ec-4f01-a645-bc12cab4c1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.673874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d5f5-83ec-4f01-a645-bc12cab4c1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.674182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d5f5-83ec-4f01-a645-bc12cab4c1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.674893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5d5f5-83ec-4f01-a645-bc12cab4c1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:15.676764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5d5f5-83ec-4f01-a645-bc12cab4c1c0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:15.776167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 942/1891] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:15 2021] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:15.780261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec4c08-f308-4547-9928-2828b9b4bc15 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:15.798875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec4c08-f308-4547-9928-2828b9b4bc15 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.857057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4280367-d63d-4a84-a5df-f1186c732c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.857723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4280367-d63d-4a84-a5df-f1186c732c1a admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.858003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4280367-d63d-4a84-a5df-f1186c732c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.858562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4280367-d63d-4a84-a5df-f1186c732c1a admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.859275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4280367-d63d-4a84-a5df-f1186c732c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:15.861329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4280367-d63d-4a84-a5df-f1186c732c1a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:15.968174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 950/1892] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:15 2021] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:15.972475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d5f5-83ec-4f01-a645-bc12cab4c1c0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:15.988196 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d5f5-83ec-4f01-a645-bc12cab4c1c0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:15.989709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abf574-3852-4654-9fcc-34cb4a5e9a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:15.990494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abf574-3852-4654-9fcc-34cb4a5e9a47 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:15.990910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abf574-3852-4654-9fcc-34cb4a5e9a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:15.991207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57abf574-3852-4654-9fcc-34cb4a5e9a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:15.991950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abf574-3852-4654-9fcc-34cb4a5e9a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:15.994182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57abf574-3852-4654-9fcc-34cb4a5e9a47 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.015435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 943/1893] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:15 2021] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:16.022315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4280367-d63d-4a84-a5df-f1186c732c1a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.025303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abf574-3852-4654-9fcc-34cb4a5e9a47 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.033115 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-57abf574-3852-4654-9fcc-34cb4a5e9a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.036170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4280367-d63d-4a84-a5df-f1186c732c1a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.041165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57abf574-3852-4654-9fcc-34cb4a5e9a47 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.046435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.047526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.047918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.048197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] PATH_INFO: `/v3/projects/892d6fc7e003438da2418f7e2c07c897` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.049535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=892d6fc7e003438da2418f7e2c07c897)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.051576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.068785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfcb38-94c5-4921-afe5-32866a89648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.069467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfcb38-94c5-4921-afe5-32866a89648e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.069751 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfcb38-94c5-4921-afe5-32866a89648e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.070051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfcb38-94c5-4921-afe5-32866a89648e admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.070858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfcb38-94c5-4921-afe5-32866a89648e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.072638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cfcb38-94c5-4921-afe5-32866a89648e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.088945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 951/1894] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:16.089320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfcb38-94c5-4921-afe5-32866a89648e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.099040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cfcb38-94c5-4921-afe5-32866a89648e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.104230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b351e87-e8f9-4261-98bc-36ef3d6d31d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.105097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351e87-e8f9-4261-98bc-36ef3d6d31d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.105376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351e87-e8f9-4261-98bc-36ef3d6d31d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.105643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b351e87-e8f9-4261-98bc-36ef3d6d31d6 admin admin] PATH_INFO: `/v3/projects/b6ba2634d8794896bebc2b39ed15d443/users/87464ccd3ccf4238a210c6f628011444/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.120841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b351e87-e8f9-4261-98bc-36ef3d6d31d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6ba2634d8794896bebc2b39ed15d443, user_id=87464ccd3ccf4238a210c6f628011444, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.123505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b351e87-e8f9-4261-98bc-36ef3d6d31d6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.245869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 952/1895] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:16 2021] PUT /identity/v3/projects/b6ba2634d8794896bebc2b39ed15d443/users/87464ccd3ccf4238a210c6f628011444/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:16.257233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e20f7-4c81-4f06-8bab-30c4d4e53bc8 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.257525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e20f7-4c81-4f06-8bab-30c4d4e53bc8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.257805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e20f7-4c81-4f06-8bab-30c4d4e53bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.263525 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '892d6fc7e003438da2418f7e2c07c897', 'request_id': 'req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.271851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '892d6fc7e003438da2418f7e2c07c897', 'request_id': 'req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.275912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '892d6fc7e003438da2418f7e2c07c897', 'request_id': 'req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.285787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-186e20f7-4c81-4f06-8bab-30c4d4e53bc8 None None] MFA Rules not processed for user `87464ccd3ccf4238a210c6f628011444`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:16.287115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-186e20f7-4c81-4f06-8bab-30c4d4e53bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.349734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 953/1896] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:16 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:16.355047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e20f7-4c81-4f06-8bab-30c4d4e53bc8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.356159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] The token cache is being invalidate because project 892d6fc7e003438da2418f7e2c07c897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:16.358000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.358000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.358984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 944/1897] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:16 2021] DELETE /identity/v3/projects/892d6fc7e003438da2418f7e2c07c897 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:16.362857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.364568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.424111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e20f7-4c81-4f06-8bab-30c4d4e53bc8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.428935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcb6ef-5698-4986-9fe8-da23fd729bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.429252 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d034d2f-ad5b-442e-8ddf-b510ae509cf7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.429623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb6ef-5698-4986-9fe8-da23fd729bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.430016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb6ef-5698-4986-9fe8-da23fd729bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.430760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dcb6ef-5698-4986-9fe8-da23fd729bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.431340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb6ef-5698-4986-9fe8-da23fd729bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.433245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dcb6ef-5698-4986-9fe8-da23fd729bf9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.434146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.435010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.435290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.435564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] PATH_INFO: `/v3/users/116c6426c73f4d858da860172969f83f` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.436784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=116c6426c73f4d858da860172969f83f)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.438711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.512109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 954/1898] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:16 2021] POST /identity/v3/projects => generated 381 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:16.513066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcb6ef-5698-4986-9fe8-da23fd729bf9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.514612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b8dcb6ef-5698-4986-9fe8-da23fd729bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.575590 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dcb6ef-5698-4986-9fe8-da23fd729bf9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.580127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.580985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.581284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.581548 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] PATH_INFO: `/v3/users/acf96142186449839804dd057ebb0e76` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.582761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf96142186449839804dd057ebb0e76)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.584711 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.605350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '116c6426c73f4d858da860172969f83f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.618399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '116c6426c73f4d858da860172969f83f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.625105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '116c6426c73f4d858da860172969f83f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.625859 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '116c6426c73f4d858da860172969f83f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.669647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '116c6426c73f4d858da860172969f83f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.675601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 945/1899] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:16 2021] DELETE /identity/v3/users/116c6426c73f4d858da860172969f83f => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:16.676352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.677625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.731315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf96142186449839804dd057ebb0e76'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.744520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf96142186449839804dd057ebb0e76'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.745457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6382d0b4-fbf7-45a3-abe7-29b6ba75fd1e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.750863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78204b4-4451-4737-bc2c-8451e2cabaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.751534 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78204b4-4451-4737-bc2c-8451e2cabaae admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.751753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf96142186449839804dd057ebb0e76'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.751872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78204b4-4451-4737-bc2c-8451e2cabaae admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.752079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78204b4-4451-4737-bc2c-8451e2cabaae admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.752791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78204b4-4451-4737-bc2c-8451e2cabaae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.754736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78204b4-4451-4737-bc2c-8451e2cabaae admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.807408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf96142186449839804dd057ebb0e76'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.808015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-52c707f9-89d9-4619-b602-c6713d6f65aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf96142186449839804dd057ebb0e76'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:16.814217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 955/1900] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:16 2021] DELETE /identity/v3/users/acf96142186449839804dd057ebb0e76 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:16.818335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313d044-ed05-429a-acdb-211c5827401a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.818618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313d044-ed05-429a-acdb-211c5827401a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.818885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313d044-ed05-429a-acdb-211c5827401a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.835223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8313d044-ed05-429a-acdb-211c5827401a None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:16.836758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8313d044-ed05-429a-acdb-211c5827401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.843767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 946/1901] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:16 2021] POST /identity/v3/users => generated 291 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:16.852781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78204b4-4451-4737-bc2c-8451e2cabaae admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.855385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c78204b4-4451-4737-bc2c-8451e2cabaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.870390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78204b4-4451-4737-bc2c-8451e2cabaae admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.900374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 956/1902] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:16.910394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313d044-ed05-429a-acdb-211c5827401a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.912114 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8313d044-ed05-429a-acdb-211c5827401a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:16.953253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd17b4-9602-4c16-9a5b-f00ea61f47de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.954082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd17b4-9602-4c16-9a5b-f00ea61f47de admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.954439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd17b4-9602-4c16-9a5b-f00ea61f47de admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.954768 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cd17b4-9602-4c16-9a5b-f00ea61f47de admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.955522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd17b4-9602-4c16-9a5b-f00ea61f47de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.957095 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cd17b4-9602-4c16-9a5b-f00ea61f47de admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.968547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 947/1903] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:16.972144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313d044-ed05-429a-acdb-211c5827401a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.972416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd17b4-9602-4c16-9a5b-f00ea61f47de admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:16.976379 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6213f-c840-4537-90d4-e4215b662a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.977721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6213f-c840-4537-90d4-e4215b662a6d service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.977867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6213f-c840-4537-90d4-e4215b662a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.978198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6213f-c840-4537-90d4-e4215b662a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.982936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cd17b4-9602-4c16-9a5b-f00ea61f47de admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:16.987834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535e6c-dd7f-46cd-8b63-513aa1a7dd8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:16.988498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535e6c-dd7f-46cd-8b63-513aa1a7dd8b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:16.988708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6213f-c840-4537-90d4-e4215b662a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.988816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535e6c-dd7f-46cd-8b63-513aa1a7dd8b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:16.989029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7535e6c-dd7f-46cd-8b63-513aa1a7dd8b admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:16.989785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7535e6c-dd7f-46cd-8b63-513aa1a7dd8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:16.990445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b6213f-c840-4537-90d4-e4215b662a6d service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:16.991385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7535e6c-dd7f-46cd-8b63-513aa1a7dd8b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.005450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 948/1904] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:17.006209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 957/1905] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:17.006375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535e6c-dd7f-46cd-8b63-513aa1a7dd8b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.019160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7535e6c-dd7f-46cd-8b63-513aa1a7dd8b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.024856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37887c2-bacf-421f-85f2-4375b7468e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.025738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37887c2-bacf-421f-85f2-4375b7468e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.027217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37887c2-bacf-421f-85f2-4375b7468e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.027217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37887c2-bacf-421f-85f2-4375b7468e81 admin admin] PATH_INFO: `/v3/projects/af1736e3d31b4abbb30d82a0a7c0a4b2/users/8e543c9e7a994bfc9077f7a5226d0b29/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.041730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37887c2-bacf-421f-85f2-4375b7468e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af1736e3d31b4abbb30d82a0a7c0a4b2, user_id=8e543c9e7a994bfc9077f7a5226d0b29, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.044369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37887c2-bacf-421f-85f2-4375b7468e81 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.123952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6213f-c840-4537-90d4-e4215b662a6d service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.125089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-98b6213f-c840-4537-90d4-e4215b662a6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:17.143900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b6213f-c840-4537-90d4-e4215b662a6d service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.150131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.151000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.153552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.153552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] PATH_INFO: `/v3/projects/62d675a6537a4f4eb41ccaed0840bb13` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.153552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d675a6537a4f4eb41ccaed0840bb13)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.154282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 949/1906] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:17 2021] PUT /identity/v3/projects/af1736e3d31b4abbb30d82a0a7c0a4b2/users/8e543c9e7a994bfc9077f7a5226d0b29/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:17.154837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.163354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c15fb-ad30-4a89-a2f2-de3f6349a4dd None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.163637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c15fb-ad30-4a89-a2f2-de3f6349a4dd None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.163935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758c15fb-ad30-4a89-a2f2-de3f6349a4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.192402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-758c15fb-ad30-4a89-a2f2-de3f6349a4dd None None] MFA Rules not processed for user `8e543c9e7a994bfc9077f7a5226d0b29`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:17.193674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-758c15fb-ad30-4a89-a2f2-de3f6349a4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:17.254954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 950/1907] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:17 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:17.259844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c15fb-ad30-4a89-a2f2-de3f6349a4dd None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.317032 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758c15fb-ad30-4a89-a2f2-de3f6349a4dd None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.322299 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc2dd8-bf5c-4067-a0aa-2e5bf89d1d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.322944 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2dd8-bf5c-4067-a0aa-2e5bf89d1d21 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.323216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2dd8-bf5c-4067-a0aa-2e5bf89d1d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.323486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fc2dd8-bf5c-4067-a0aa-2e5bf89d1d21 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.324179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc2dd8-bf5c-4067-a0aa-2e5bf89d1d21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.331092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fc2dd8-bf5c-4067-a0aa-2e5bf89d1d21 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.378688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d675a6537a4f4eb41ccaed0840bb13', 'request_id': 'req-931302a1-3119-47bf-a007-079ae320903d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.384654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d675a6537a4f4eb41ccaed0840bb13', 'request_id': 'req-931302a1-3119-47bf-a007-079ae320903d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.390079 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d675a6537a4f4eb41ccaed0840bb13', 'request_id': 'req-931302a1-3119-47bf-a007-079ae320903d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.466799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 951/1908] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:17 2021] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:17.471098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc2dd8-bf5c-4067-a0aa-2e5bf89d1d21 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.517535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] The token cache is being invalidate because project 62d675a6537a4f4eb41ccaed0840bb13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:17.517814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.520329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-931302a1-3119-47bf-a007-079ae320903d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.520329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 958/1909] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:17 2021] DELETE /identity/v3/projects/62d675a6537a4f4eb41ccaed0840bb13 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:17.527357 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8237-5cbd-4718-a437-57b22274cffa None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.527732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8237-5cbd-4718-a437-57b22274cffa None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.527921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c8237-5cbd-4718-a437-57b22274cffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.542379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fc2dd8-bf5c-4067-a0aa-2e5bf89d1d21 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.547617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335214e7-5f02-4832-a0d1-4f5aa11ec017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.548483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335214e7-5f02-4832-a0d1-4f5aa11ec017 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.548766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335214e7-5f02-4832-a0d1-4f5aa11ec017 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.549130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335214e7-5f02-4832-a0d1-4f5aa11ec017 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.549766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-3b2c8237-5cbd-4718-a437-57b22274cffa None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:17.550011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335214e7-5f02-4832-a0d1-4f5aa11ec017 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.550997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3b2c8237-5cbd-4718-a437-57b22274cffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:17.552162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335214e7-5f02-4832-a0d1-4f5aa11ec017 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.562063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 959/1910] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:17.570348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb2cef-17e9-4e50-ae6f-0e7fcf46cc6d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.570737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb2cef-17e9-4e50-ae6f-0e7fcf46cc6d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.571083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb2cef-17e9-4e50-ae6f-0e7fcf46cc6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.591006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-91bb2cef-17e9-4e50-ae6f-0e7fcf46cc6d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:17.592187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-91bb2cef-17e9-4e50-ae6f-0e7fcf46cc6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:17.600654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 960/1911] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:17.605299 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb2cef-17e9-4e50-ae6f-0e7fcf46cc6d None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.614287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb2cef-17e9-4e50-ae6f-0e7fcf46cc6d None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.619610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd1d74-308a-453a-ba89-3368e7eec6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.620235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd1d74-308a-453a-ba89-3368e7eec6df admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.620508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd1d74-308a-453a-ba89-3368e7eec6df admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.620775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bd1d74-308a-453a-ba89-3368e7eec6df admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.621492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd1d74-308a-453a-ba89-3368e7eec6df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:17.621787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd1d74-308a-453a-ba89-3368e7eec6df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.623374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bd1d74-308a-453a-ba89-3368e7eec6df admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.634506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 961/1912] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:17.638498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd1d74-308a-453a-ba89-3368e7eec6df admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.647784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bd1d74-308a-453a-ba89-3368e7eec6df admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.653019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cf896-0e83-400e-9ee6-6feded4ddf4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.653629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf896-0e83-400e-9ee6-6feded4ddf4e admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.653923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf896-0e83-400e-9ee6-6feded4ddf4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.654210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71cf896-0e83-400e-9ee6-6feded4ddf4e admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.654904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cf896-0e83-400e-9ee6-6feded4ddf4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.656721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71cf896-0e83-400e-9ee6-6feded4ddf4e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.665636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 952/1913] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:17 2021] POST /identity/v3/users => generated 299 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:17.669031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335214e7-5f02-4832-a0d1-4f5aa11ec017 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.670780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-335214e7-5f02-4832-a0d1-4f5aa11ec017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:17.682644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335214e7-5f02-4832-a0d1-4f5aa11ec017 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.688908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc04703-612b-48c5-b375-8bdea0c29389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.689576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc04703-612b-48c5-b375-8bdea0c29389 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.689856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc04703-612b-48c5-b375-8bdea0c29389 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.690149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc04703-612b-48c5-b375-8bdea0c29389 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.690888 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc04703-612b-48c5-b375-8bdea0c29389 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.692538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc04703-612b-48c5-b375-8bdea0c29389 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.703651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 953/1914] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:17 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:17.709458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc04703-612b-48c5-b375-8bdea0c29389 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.709458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6bc04703-612b-48c5-b375-8bdea0c29389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:17.721874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc04703-612b-48c5-b375-8bdea0c29389 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.726534 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.727992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.728262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.728569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] PATH_INFO: `/v3/projects/644419e9f4ff44248a448ac113de7d1e` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.729747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=644419e9f4ff44248a448ac113de7d1e)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.731708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.751663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 962/1915] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:17 2021] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:17.752423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cf896-0e83-400e-9ee6-6feded4ddf4e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.814710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71cf896-0e83-400e-9ee6-6feded4ddf4e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.819991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '644419e9f4ff44248a448ac113de7d1e', 'request_id': 'req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.826705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '644419e9f4ff44248a448ac113de7d1e', 'request_id': 'req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.832462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '644419e9f4ff44248a448ac113de7d1e', 'request_id': 'req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.874626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981b0ce-8fa6-4482-9b8e-667235e7113e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.875508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981b0ce-8fa6-4482-9b8e-667235e7113e admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.875782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981b0ce-8fa6-4482-9b8e-667235e7113e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.876051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1981b0ce-8fa6-4482-9b8e-667235e7113e admin admin] PATH_INFO: `/v3/projects/64e7dcdb94fe420691f9e7712444515e/users/bafadaea769b4f92ba0268ac2c1bf64c/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.888532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] The token cache is being invalidate because project 644419e9f4ff44248a448ac113de7d1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:17.888532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.888532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:17.889300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 954/1916] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:17 2021] DELETE /identity/v3/projects/644419e9f4ff44248a448ac113de7d1e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:17.890130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.891307 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:17.892968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981b0ce-8fa6-4482-9b8e-667235e7113e admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e7dcdb94fe420691f9e7712444515e, user_id=bafadaea769b4f92ba0268ac2c1bf64c, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.895612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1981b0ce-8fa6-4482-9b8e-667235e7113e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.907506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8462e9-010d-46d2-8d19-9c5d3de5be2d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:17.912889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79713d-8969-4844-9774-2c9d08659614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:17.913554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79713d-8969-4844-9774-2c9d08659614 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:17.913830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79713d-8969-4844-9774-2c9d08659614 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:17.914131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f79713d-8969-4844-9774-2c9d08659614 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:17.915581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79713d-8969-4844-9774-2c9d08659614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:17.917450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f79713d-8969-4844-9774-2c9d08659614 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:17.956247 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 963/1917] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:17 2021] PUT /identity/v3/projects/64e7dcdb94fe420691f9e7712444515e/users/bafadaea769b4f92ba0268ac2c1bf64c/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:17.957070 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981b0ce-8fa6-4482-9b8e-667235e7113e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.958663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1981b0ce-8fa6-4482-9b8e-667235e7113e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:17.979670 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 955/1918] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:17 2021] POST /identity/v3/users => generated 291 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:17.980684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79713d-8969-4844-9774-2c9d08659614 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:17.982278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1f79713d-8969-4844-9774-2c9d08659614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:17.994541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f79713d-8969-4844-9774-2c9d08659614 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.023563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1981b0ce-8fa6-4482-9b8e-667235e7113e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.028840 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.029705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.030011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.030310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] PATH_INFO: `/v3/users/16a54cb1df4b4b64b84435e5afc9017f` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.031507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a54cb1df4b4b64b84435e5afc9017f)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.033424 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.049170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56357b02-d66e-46cf-8774-7f495a89a773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.049831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56357b02-d66e-46cf-8774-7f495a89a773 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.050131 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56357b02-d66e-46cf-8774-7f495a89a773 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.050406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56357b02-d66e-46cf-8774-7f495a89a773 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.051168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56357b02-d66e-46cf-8774-7f495a89a773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.052699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56357b02-d66e-46cf-8774-7f495a89a773 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.062382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 956/1919] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:17 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:18.063176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56357b02-d66e-46cf-8774-7f495a89a773 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:18.072721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56357b02-d66e-46cf-8774-7f495a89a773 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.077282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0a59-98f4-4d51-90f4-ad6515d59703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.077889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0a59-98f4-4d51-90f4-ad6515d59703 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.078208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0a59-98f4-4d51-90f4-ad6515d59703 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.078479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d0a59-98f4-4d51-90f4-ad6515d59703 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.079182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d0a59-98f4-4d51-90f4-ad6515d59703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.080680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d0a59-98f4-4d51-90f4-ad6515d59703 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.090818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 957/1920] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:18 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:18.091566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0a59-98f4-4d51-90f4-ad6515d59703 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:18.100333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d0a59-98f4-4d51-90f4-ad6515d59703 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.104955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020251f-2d54-4e1b-938c-1c80de62699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.105765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020251f-2d54-4e1b-938c-1c80de62699c admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.106059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020251f-2d54-4e1b-938c-1c80de62699c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.106331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020251f-2d54-4e1b-938c-1c80de62699c admin admin] PATH_INFO: `/v3/projects/64e7dcdb94fe420691f9e7712444515e/users/bafadaea769b4f92ba0268ac2c1bf64c/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.108503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020251f-2d54-4e1b-938c-1c80de62699c admin admin] RBAC: Authorizing `identity:create_grant(project_id=64e7dcdb94fe420691f9e7712444515e, user_id=bafadaea769b4f92ba0268ac2c1bf64c, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.111057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1020251f-2d54-4e1b-938c-1c80de62699c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.121617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 958/1921] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:18 2021] PUT /identity/v3/projects/64e7dcdb94fe420691f9e7712444515e/users/bafadaea769b4f92ba0268ac2c1bf64c/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:18.128287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020251f-2d54-4e1b-938c-1c80de62699c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:18.181541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020251f-2d54-4e1b-938c-1c80de62699c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.186363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae34da0-44bf-4c5c-b386-92df4bbe7dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.187014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34da0-44bf-4c5c-b386-92df4bbe7dff admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.187289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34da0-44bf-4c5c-b386-92df4bbe7dff admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.187555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae34da0-44bf-4c5c-b386-92df4bbe7dff admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.188279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae34da0-44bf-4c5c-b386-92df4bbe7dff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.189968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae34da0-44bf-4c5c-b386-92df4bbe7dff admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.194177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a54cb1df4b4b64b84435e5afc9017f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:18.200482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 959/1922] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:18 2021] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:18.201869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8264-ab8b-449c-a6d0-e37743d4ee3d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.202280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8264-ab8b-449c-a6d0-e37743d4ee3d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.202655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec8264-ab8b-449c-a6d0-e37743d4ee3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.206738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a54cb1df4b4b64b84435e5afc9017f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:18.214074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a54cb1df4b4b64b84435e5afc9017f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:18.229160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d1ec8264-ab8b-449c-a6d0-e37743d4ee3d None None] MFA Rules not processed for user `bafadaea769b4f92ba0268ac2c1bf64c`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:18.230393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d1ec8264-ab8b-449c-a6d0-e37743d4ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:18.276922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a54cb1df4b4b64b84435e5afc9017f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:18.277631 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a54cb1df4b4b64b84435e5afc9017f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:18.284809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 964/1923] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:17 2021] DELETE /identity/v3/users/16a54cb1df4b4b64b84435e5afc9017f => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:18.287951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:18.288061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:18.318485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 960/1924] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:18 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:18.331540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec8264-ab8b-449c-a6d0-e37743d4ee3d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:18.335301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d1ec8264-ab8b-449c-a6d0-e37743d4ee3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:18.369397 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9562aef-4085-47b0-9bc6-f0254cc8cd4e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.381464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363d14e-340d-4fe8-9c1f-a61ef6f06362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.382986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363d14e-340d-4fe8-9c1f-a61ef6f06362 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.384034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363d14e-340d-4fe8-9c1f-a61ef6f06362 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.385432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363d14e-340d-4fe8-9c1f-a61ef6f06362 admin admin] PATH_INFO: `/v3/projects/7dc56696bc054c3a8eeb9826505d203f/users/cf435aa541a544b28e00f15005237289/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.407609 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363d14e-340d-4fe8-9c1f-a61ef6f06362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dc56696bc054c3a8eeb9826505d203f, user_id=cf435aa541a544b28e00f15005237289, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.411151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363d14e-340d-4fe8-9c1f-a61ef6f06362 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.416185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec8264-ab8b-449c-a6d0-e37743d4ee3d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.469096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b0498-ac34-4263-b1dc-897eee9e2137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.469747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b0498-ac34-4263-b1dc-897eee9e2137 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.470046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b0498-ac34-4263-b1dc-897eee9e2137 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.470318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4b0498-ac34-4263-b1dc-897eee9e2137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.472085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-bf4b0498-ac34-4263-b1dc-897eee9e2137 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:18.530318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b0498-ac34-4263-b1dc-897eee9e2137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.531732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4b0498-ac34-4263-b1dc-897eee9e2137 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.535740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 965/1925] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:18 2021] PUT /identity/v3/projects/7dc56696bc054c3a8eeb9826505d203f/users/cf435aa541a544b28e00f15005237289/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:18.540620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 961/1926] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:18 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:18.546554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aff9e-39d3-4f82-93f3-3b2802d44f12 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.546836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aff9e-39d3-4f82-93f3-3b2802d44f12 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.547188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25aff9e-39d3-4f82-93f3-3b2802d44f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.574089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c25aff9e-39d3-4f82-93f3-3b2802d44f12 None None] MFA Rules not processed for user `cf435aa541a544b28e00f15005237289`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:18.575279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c25aff9e-39d3-4f82-93f3-3b2802d44f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:18.646153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 966/1927] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:18 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:18.650541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b0498-ac34-4263-b1dc-897eee9e2137 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:18.663088 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4b0498-ac34-4263-b1dc-897eee9e2137 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.723741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f527f-78c4-44a3-aaa9-52d38dcffc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.724556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f527f-78c4-44a3-aaa9-52d38dcffc4d admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.724845 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f527f-78c4-44a3-aaa9-52d38dcffc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.725119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7f527f-78c4-44a3-aaa9-52d38dcffc4d admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.725853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f527f-78c4-44a3-aaa9-52d38dcffc4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.727843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7f527f-78c4-44a3-aaa9-52d38dcffc4d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.797889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 962/1928] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:18 2021] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:18.801920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25aff9e-39d3-4f82-93f3-3b2802d44f12 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:18.817465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25aff9e-39d3-4f82-93f3-3b2802d44f12 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.818108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f527f-78c4-44a3-aaa9-52d38dcffc4d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:18.819665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0f7f527f-78c4-44a3-aaa9-52d38dcffc4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:18.881781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2a09-9460-4896-b443-b1009ca5981e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.882675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2a09-9460-4896-b443-b1009ca5981e admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.883134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2a09-9460-4896-b443-b1009ca5981e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.883727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7c2a09-9460-4896-b443-b1009ca5981e admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.889318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2a09-9460-4896-b443-b1009ca5981e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.889318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7c2a09-9460-4896-b443-b1009ca5981e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.904938 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7f527f-78c4-44a3-aaa9-52d38dcffc4d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:18.907668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:18.908530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:18.908869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:18.909091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] PATH_INFO: `/v3/projects/f0530bda7fd4412eb042e98e827ff094` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:18.910932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0530bda7fd4412eb042e98e827ff094)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:18.912798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:18.999527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 967/1929] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:18 2021] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:19.003838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2a09-9460-4896-b443-b1009ca5981e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.013206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0530bda7fd4412eb042e98e827ff094', 'request_id': 'req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:19.014176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7c2a09-9460-4896-b443-b1009ca5981e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.019912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0530bda7fd4412eb042e98e827ff094', 'request_id': 'req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:19.025511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0530bda7fd4412eb042e98e827ff094', 'request_id': 'req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:19.073311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065426d6-b9c1-473f-8080-20cb8c6b4365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.073983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065426d6-b9c1-473f-8080-20cb8c6b4365 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.074342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065426d6-b9c1-473f-8080-20cb8c6b4365 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.074617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065426d6-b9c1-473f-8080-20cb8c6b4365 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.075349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065426d6-b9c1-473f-8080-20cb8c6b4365 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.076939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065426d6-b9c1-473f-8080-20cb8c6b4365 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.089606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 968/1930] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:19.092705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065426d6-b9c1-473f-8080-20cb8c6b4365 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.102944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065426d6-b9c1-473f-8080-20cb8c6b4365 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.107824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5c52c-0d16-4779-9088-d6e5d96acf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.108948 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5c52c-0d16-4779-9088-d6e5d96acf9e admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.109232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5c52c-0d16-4779-9088-d6e5d96acf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.109506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5c52c-0d16-4779-9088-d6e5d96acf9e admin admin] PATH_INFO: `/v3/projects/292414df5882486183e1bbd6ae384885/users/6a41c663e4044b99aa1f35cb88410d0c/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.122210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] The token cache is being invalidate because project f0530bda7fd4412eb042e98e827ff094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:19.122635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:19.123734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4db9f1c7-3f4d-42b6-85fc-6ad3a16e62cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:19.125840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 963/1931] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:18 2021] DELETE /identity/v3/projects/f0530bda7fd4412eb042e98e827ff094 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:19.131373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246260a-35f3-4c85-a861-2d05bc62d4d1 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.131655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246260a-35f3-4c85-a861-2d05bc62d4d1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.131920 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0246260a-35f3-4c85-a861-2d05bc62d4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.135305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5c52c-0d16-4779-9088-d6e5d96acf9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=292414df5882486183e1bbd6ae384885, user_id=6a41c663e4044b99aa1f35cb88410d0c, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.138393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b5c52c-0d16-4779-9088-d6e5d96acf9e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.151083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0246260a-35f3-4c85-a861-2d05bc62d4d1 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:19.152300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0246260a-35f3-4c85-a861-2d05bc62d4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.160199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 964/1932] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:19.168487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f56933-bd05-4ca4-be01-37b9c2be317c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.168758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f56933-bd05-4ca4-be01-37b9c2be317c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.169031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f56933-bd05-4ca4-be01-37b9c2be317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.186723 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-a0f56933-bd05-4ca4-be01-37b9c2be317c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:19.187946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a0f56933-bd05-4ca4-be01-37b9c2be317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.197519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 965/1933] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:19.201700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f56933-bd05-4ca4-be01-37b9c2be317c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.210617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f56933-bd05-4ca4-be01-37b9c2be317c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.216185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9e398-040d-4f1e-bdeb-25205ec83d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.216887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9e398-040d-4f1e-bdeb-25205ec83d95 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.217166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9e398-040d-4f1e-bdeb-25205ec83d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.217436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a9e398-040d-4f1e-bdeb-25205ec83d95 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.218214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9e398-040d-4f1e-bdeb-25205ec83d95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:19.218517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9e398-040d-4f1e-bdeb-25205ec83d95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.220096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a9e398-040d-4f1e-bdeb-25205ec83d95 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.228621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 969/1934] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:19 2021] PUT /identity/v3/projects/292414df5882486183e1bbd6ae384885/users/6a41c663e4044b99aa1f35cb88410d0c/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:19.232634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5c52c-0d16-4779-9088-d6e5d96acf9e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.234683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-00b5c52c-0d16-4779-9088-d6e5d96acf9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.235842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 966/1935] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:19.246844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9e398-040d-4f1e-bdeb-25205ec83d95 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.258789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a9e398-040d-4f1e-bdeb-25205ec83d95 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.334764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5c52c-0d16-4779-9088-d6e5d96acf9e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.342129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6f4de-fe6f-448a-9168-6c971d7c2f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.342898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6f4de-fe6f-448a-9168-6c971d7c2f7a admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.343142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb81829-4782-4a40-99df-25cbeb1d6b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.343268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6f4de-fe6f-448a-9168-6c971d7c2f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.343507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f6f4de-fe6f-448a-9168-6c971d7c2f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.344215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6f4de-fe6f-448a-9168-6c971d7c2f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.344489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb81829-4782-4a40-99df-25cbeb1d6b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.344938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb81829-4782-4a40-99df-25cbeb1d6b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.345378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb81829-4782-4a40-99df-25cbeb1d6b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.346325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f6f4de-fe6f-448a-9168-6c971d7c2f7a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.347233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb81829-4782-4a40-99df-25cbeb1d6b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.348885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb81829-4782-4a40-99df-25cbeb1d6b1f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.361584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 970/1936] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:19.365643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb81829-4782-4a40-99df-25cbeb1d6b1f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.376107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb81829-4782-4a40-99df-25cbeb1d6b1f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.381138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16850684-2fb1-40b8-905d-e8759a92d904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.382077 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16850684-2fb1-40b8-905d-e8759a92d904 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.382363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16850684-2fb1-40b8-905d-e8759a92d904 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.382634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16850684-2fb1-40b8-905d-e8759a92d904 admin admin] PATH_INFO: `/v3/projects/292414df5882486183e1bbd6ae384885/users/6a41c663e4044b99aa1f35cb88410d0c/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.385193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16850684-2fb1-40b8-905d-e8759a92d904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=292414df5882486183e1bbd6ae384885, user_id=6a41c663e4044b99aa1f35cb88410d0c, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.387841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16850684-2fb1-40b8-905d-e8759a92d904 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.397917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 971/1937] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:19 2021] PUT /identity/v3/projects/292414df5882486183e1bbd6ae384885/users/6a41c663e4044b99aa1f35cb88410d0c/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:19.408536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1018e-51ac-4a02-acea-373689837d62 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.408822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1018e-51ac-4a02-acea-373689837d62 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.409100 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd1018e-51ac-4a02-acea-373689837d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.435435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-bbd1018e-51ac-4a02-acea-373689837d62 None None] MFA Rules not processed for user `6a41c663e4044b99aa1f35cb88410d0c`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:19.436728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bbd1018e-51ac-4a02-acea-373689837d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.443733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 967/1938] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:19.448553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6f4de-fe6f-448a-9168-6c971d7c2f7a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.509598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 972/1939] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/auth/tokens => generated 3470 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:19.511699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f6f4de-fe6f-448a-9168-6c971d7c2f7a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.516773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6acb0-8eb8-4ea2-a10e-ea6cac3047f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.517444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6acb0-8eb8-4ea2-a10e-ea6cac3047f0 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.517727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6acb0-8eb8-4ea2-a10e-ea6cac3047f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.518006 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba6acb0-8eb8-4ea2-a10e-ea6cac3047f0 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.518757 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6acb0-8eb8-4ea2-a10e-ea6cac3047f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.519585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1018e-51ac-4a02-acea-373689837d62 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.520644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba6acb0-8eb8-4ea2-a10e-ea6cac3047f0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.523056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bbd1018e-51ac-4a02-acea-373689837d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.587784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd1018e-51ac-4a02-acea-373689837d62 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.594175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 968/1940] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/users => generated 291 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:19.595469 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6acb0-8eb8-4ea2-a10e-ea6cac3047f0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.606911 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba6acb0-8eb8-4ea2-a10e-ea6cac3047f0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.612010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24506238-aa96-4663-99c5-dd55b2c53bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.612742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506238-aa96-4663-99c5-dd55b2c53bfa admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.613082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506238-aa96-4663-99c5-dd55b2c53bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.614063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24506238-aa96-4663-99c5-dd55b2c53bfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.614628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24506238-aa96-4663-99c5-dd55b2c53bfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.626642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24506238-aa96-4663-99c5-dd55b2c53bfa admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.643092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 969/1941] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:19.644733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24506238-aa96-4663-99c5-dd55b2c53bfa admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.657450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24506238-aa96-4663-99c5-dd55b2c53bfa admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.659936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de30603-037e-4f41-8e6d-93a2730c3dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.660601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30603-037e-4f41-8e6d-93a2730c3dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.660880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30603-037e-4f41-8e6d-93a2730c3dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.661174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30603-037e-4f41-8e6d-93a2730c3dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.665017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957923-533d-41af-aa47-8dcfdad1308e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.666475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957923-533d-41af-aa47-8dcfdad1308e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.666975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957923-533d-41af-aa47-8dcfdad1308e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.667466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b957923-533d-41af-aa47-8dcfdad1308e admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.669093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b957923-533d-41af-aa47-8dcfdad1308e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.671815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b957923-533d-41af-aa47-8dcfdad1308e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.682839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 970/1942] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:19.687169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957923-533d-41af-aa47-8dcfdad1308e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.699926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b957923-533d-41af-aa47-8dcfdad1308e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.705985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ee774-6fcf-4c41-b8ff-9733985f0656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.707013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee774-6fcf-4c41-b8ff-9733985f0656 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.707381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee774-6fcf-4c41-b8ff-9733985f0656 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.707722 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40ee774-6fcf-4c41-b8ff-9733985f0656 admin admin] PATH_INFO: `/v3/projects/260ddd5c443d4e128a9b75d7eed26ae1/users/8c25bf40d13f4a99adc340bfac1f504c/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.724013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ee774-6fcf-4c41-b8ff-9733985f0656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=260ddd5c443d4e128a9b75d7eed26ae1, user_id=8c25bf40d13f4a99adc340bfac1f504c, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.726818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40ee774-6fcf-4c41-b8ff-9733985f0656 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.731616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de30603-037e-4f41-8e6d-93a2730c3dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.734133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de30603-037e-4f41-8e6d-93a2730c3dd7 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.744668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 973/1943] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/auth/tokens => generated 3470 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:19.802085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 971/1944] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:19 2021] PUT /identity/v3/projects/260ddd5c443d4e128a9b75d7eed26ae1/users/8c25bf40d13f4a99adc340bfac1f504c/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:19.813479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46bb9-64f3-44be-b4e9-1545ba20f32a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.813771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46bb9-64f3-44be-b4e9-1545ba20f32a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.814075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46bb9-64f3-44be-b4e9-1545ba20f32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.841470 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ee774-6fcf-4c41-b8ff-9733985f0656 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.841856 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b3e46bb9-64f3-44be-b4e9-1545ba20f32a None None] MFA Rules not processed for user `8c25bf40d13f4a99adc340bfac1f504c`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:19.843198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b3e46bb9-64f3-44be-b4e9-1545ba20f32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.895810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40ee774-6fcf-4c41-b8ff-9733985f0656 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.900400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62a548-b9ed-4af7-92de-403747333bb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.901157 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62a548-b9ed-4af7-92de-403747333bb0 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.901443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62a548-b9ed-4af7-92de-403747333bb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.901715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b62a548-b9ed-4af7-92de-403747333bb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.903824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4b62a548-b9ed-4af7-92de-403747333bb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:19.908497 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 974/1945] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:19.912840 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46bb9-64f3-44be-b4e9-1545ba20f32a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:19.961953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62a548-b9ed-4af7-92de-403747333bb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.963862 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b62a548-b9ed-4af7-92de-403747333bb0 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:19.972513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46bb9-64f3-44be-b4e9-1545ba20f32a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:19.973063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 972/1946] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:19 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:19.977282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7481a-e26c-46ed-a04e-fb36624fb269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:19.978221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7481a-e26c-46ed-a04e-fb36624fb269 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:19.978312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7481a-e26c-46ed-a04e-fb36624fb269 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:19.978580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd7481a-e26c-46ed-a04e-fb36624fb269 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:19.979195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7481a-e26c-46ed-a04e-fb36624fb269 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:19.981069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd7481a-e26c-46ed-a04e-fb36624fb269 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.094455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 975/1947] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:19 2021] POST /identity/v3/projects => generated 381 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:20.098763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62a548-b9ed-4af7-92de-403747333bb0 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:20.110773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b62a548-b9ed-4af7-92de-403747333bb0 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:20.168764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461708-ccb9-4b1e-b2e1-718147dc7d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:20.169448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461708-ccb9-4b1e-b2e1-718147dc7d7f admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.169725 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461708-ccb9-4b1e-b2e1-718147dc7d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.170001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c461708-ccb9-4b1e-b2e1-718147dc7d7f admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.170736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c461708-ccb9-4b1e-b2e1-718147dc7d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:20.172759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c461708-ccb9-4b1e-b2e1-718147dc7d7f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.300623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 973/1948] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:20 2021] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:20.305918 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7481a-e26c-46ed-a04e-fb36624fb269 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:20.316087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd7481a-e26c-46ed-a04e-fb36624fb269 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:20.320868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556dc41-8596-4706-97dd-f04a0ef4324e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:20.321754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556dc41-8596-4706-97dd-f04a0ef4324e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.322066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556dc41-8596-4706-97dd-f04a0ef4324e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.322362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556dc41-8596-4706-97dd-f04a0ef4324e admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.323088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556dc41-8596-4706-97dd-f04a0ef4324e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:20.324694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556dc41-8596-4706-97dd-f04a0ef4324e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.335488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 976/1949] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:20.341024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461708-ccb9-4b1e-b2e1-718147dc7d7f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:20.354167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c461708-ccb9-4b1e-b2e1-718147dc7d7f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:20.357818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e166f5-0d36-4105-9049-6d262581b5b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:20.358993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e166f5-0d36-4105-9049-6d262581b5b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.359271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e166f5-0d36-4105-9049-6d262581b5b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.359556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e166f5-0d36-4105-9049-6d262581b5b3 admin admin] PATH_INFO: `/v3/projects/0f1a30cf0d3641548271e3507f22eb0b/users/3562a5970a914d00957bce61328302f6/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.376792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e166f5-0d36-4105-9049-6d262581b5b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1a30cf0d3641548271e3507f22eb0b, user_id=3562a5970a914d00957bce61328302f6, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:20.379644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e166f5-0d36-4105-9049-6d262581b5b3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.462566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 974/1950] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:20 2021] PUT /identity/v3/projects/0f1a30cf0d3641548271e3507f22eb0b/users/3562a5970a914d00957bce61328302f6/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:20.466235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556dc41-8596-4706-97dd-f04a0ef4324e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:20.478019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556dc41-8596-4706-97dd-f04a0ef4324e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:20.478465 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e166f5-0d36-4105-9049-6d262581b5b3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:20.480197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-89e166f5-0d36-4105-9049-6d262581b5b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:20.544162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e7df2-8017-4fd3-a31a-77d4c6f5568c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:20.544856 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e7df2-8017-4fd3-a31a-77d4c6f5568c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.545248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e7df2-8017-4fd3-a31a-77d4c6f5568c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.545580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e7df2-8017-4fd3-a31a-77d4c6f5568c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.546560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e7df2-8017-4fd3-a31a-77d4c6f5568c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:20.548214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e7df2-8017-4fd3-a31a-77d4c6f5568c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.550905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e166f5-0d36-4105-9049-6d262581b5b3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:20.554904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07292a54-f6df-4f72-b53d-972930d807dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:20.555748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07292a54-f6df-4f72-b53d-972930d807dc service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.556107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07292a54-f6df-4f72-b53d-972930d807dc service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.556456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07292a54-f6df-4f72-b53d-972930d807dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.558413 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-07292a54-f6df-4f72-b53d-972930d807dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:20.560065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 977/1951] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:20 2021] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:20.564187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e7df2-8017-4fd3-a31a-77d4c6f5568c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:20.575245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e7df2-8017-4fd3-a31a-77d4c6f5568c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:20.580389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80462b2c-83ae-4e95-8365-06cf0b759f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:20.581287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80462b2c-83ae-4e95-8365-06cf0b759f04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.582192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80462b2c-83ae-4e95-8365-06cf0b759f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.582476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80462b2c-83ae-4e95-8365-06cf0b759f04 admin admin] PATH_INFO: `/v3/projects/0f1a30cf0d3641548271e3507f22eb0b/users/3562a5970a914d00957bce61328302f6/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.600886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80462b2c-83ae-4e95-8365-06cf0b759f04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f1a30cf0d3641548271e3507f22eb0b, user_id=3562a5970a914d00957bce61328302f6, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:20.605269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80462b2c-83ae-4e95-8365-06cf0b759f04 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.619337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 978/1952] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:20 2021] PUT /identity/v3/projects/0f1a30cf0d3641548271e3507f22eb0b/users/3562a5970a914d00957bce61328302f6/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:20.630225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880741-8f8f-44cd-a629-4405e1692a35 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:20.630588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880741-8f8f-44cd-a629-4405e1692a35 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:20.630935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37880741-8f8f-44cd-a629-4405e1692a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:20.662974 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07292a54-f6df-4f72-b53d-972930d807dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:20.664344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07292a54-f6df-4f72-b53d-972930d807dc service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:20.673027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-37880741-8f8f-44cd-a629-4405e1692a35 None None] MFA Rules not processed for user `3562a5970a914d00957bce61328302f6`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:20.674642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-37880741-8f8f-44cd-a629-4405e1692a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:20.691800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 975/1953] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:20 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:20.842752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 979/1954] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:20 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:21.019383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07292a54-f6df-4f72-b53d-972930d807dc service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:21.028802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07292a54-f6df-4f72-b53d-972930d807dc service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:21.096449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66adb1-9afc-41d6-b143-c882488a166b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:21.097145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66adb1-9afc-41d6-b143-c882488a166b service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:21.098121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66adb1-9afc-41d6-b143-c882488a166b service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:21.098400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe66adb1-9afc-41d6-b143-c882488a166b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:21.112541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66adb1-9afc-41d6-b143-c882488a166b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:21.114088 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe66adb1-9afc-41d6-b143-c882488a166b service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:21.125546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 976/1955] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:21 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:22.204823 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880741-8f8f-44cd-a629-4405e1692a35 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.275663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37880741-8f8f-44cd-a629-4405e1692a35 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.280342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.281203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.281482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.281754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] PATH_INFO: `/v3/users/8c25bf40d13f4a99adc340bfac1f504c` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.282983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c25bf40d13f4a99adc340bfac1f504c)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.284898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.476217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66adb1-9afc-41d6-b143-c882488a166b service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.485223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe66adb1-9afc-41d6-b143-c882488a166b service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.488954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cecd76-3789-4406-987a-b61b397ff4c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.489587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cecd76-3789-4406-987a-b61b397ff4c9 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.489775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c25bf40d13f4a99adc340bfac1f504c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:22.489879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cecd76-3789-4406-987a-b61b397ff4c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.490163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cecd76-3789-4406-987a-b61b397ff4c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.492099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-92cecd76-3789-4406-987a-b61b397ff4c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:22.501836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c25bf40d13f4a99adc340bfac1f504c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:22.509417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c25bf40d13f4a99adc340bfac1f504c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:22.553069 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cecd76-3789-4406-987a-b61b397ff4c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.554519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cecd76-3789-4406-987a-b61b397ff4c9 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.564591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 977/1956] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:22.595592 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c25bf40d13f4a99adc340bfac1f504c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:22.596220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c25bf40d13f4a99adc340bfac1f504c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:22.603206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 980/1957] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:22 2021] DELETE /identity/v3/users/8c25bf40d13f4a99adc340bfac1f504c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:22.607817 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad20e0b-5e87-41ca-b645-0b92c4ef6bc2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.608426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad20e0b-5e87-41ca-b645-0b92c4ef6bc2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.608701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad20e0b-5e87-41ca-b645-0b92c4ef6bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.626091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-5ad20e0b-5e87-41ca-b645-0b92c4ef6bc2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:22.627279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5ad20e0b-5e87-41ca-b645-0b92c4ef6bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:22.684835 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 978/1958] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:22 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:22.694167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:22.695682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:22.754337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962fb67d-06d7-4913-97fe-2a837f8ac980 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:22.758486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c80b3-6e8f-4f0e-a401-4dfc17d7d73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:22.759130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c80b3-6e8f-4f0e-a401-4dfc17d7d73a service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:22.759406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c80b3-6e8f-4f0e-a401-4dfc17d7d73a service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:22.759676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c80b3-6e8f-4f0e-a401-4dfc17d7d73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:22.768859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c80b3-6e8f-4f0e-a401-4dfc17d7d73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:22.770370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c80b3-6e8f-4f0e-a401-4dfc17d7d73a service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:22.779958 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 981/1959] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:22 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:23.186346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad20e0b-5e87-41ca-b645-0b92c4ef6bc2 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.188039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5ad20e0b-5e87-41ca-b645-0b92c4ef6bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:23.203077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad20e0b-5e87-41ca-b645-0b92c4ef6bc2 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.208684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.209557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.209831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.210266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] PATH_INFO: `/v3/projects/260ddd5c443d4e128a9b75d7eed26ae1` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.212899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=260ddd5c443d4e128a9b75d7eed26ae1)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.218186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.360380 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260ddd5c443d4e128a9b75d7eed26ae1', 'request_id': 'req-f73e0885-593b-40f2-90cb-ac04229810b5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.367388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260ddd5c443d4e128a9b75d7eed26ae1', 'request_id': 'req-f73e0885-593b-40f2-90cb-ac04229810b5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.376296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260ddd5c443d4e128a9b75d7eed26ae1', 'request_id': 'req-f73e0885-593b-40f2-90cb-ac04229810b5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.458682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] The token cache is being invalidate because project 260ddd5c443d4e128a9b75d7eed26ae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:23.459013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.459635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.461520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 979/1960] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:23 2021] DELETE /identity/v3/projects/260ddd5c443d4e128a9b75d7eed26ae1 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:23.465348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c80b3-6e8f-4f0e-a401-4dfc17d7d73a service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.474943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c80b3-6e8f-4f0e-a401-4dfc17d7d73a service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.530617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.531412 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.531692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.531964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] PATH_INFO: `/v3/users/3562a5970a914d00957bce61328302f6` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.533342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3562a5970a914d00957bce61328302f6)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.535348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.571070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:23.572514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:23.588797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e0885-593b-40f2-90cb-ac04229810b5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:23.593771 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:23.594733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.595022 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.595293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] PATH_INFO: `/v3/users/cf435aa541a544b28e00f15005237289` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.596497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf435aa541a544b28e00f15005237289)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:23.598403 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:23.709239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3562a5970a914d00957bce61328302f6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.727667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3562a5970a914d00957bce61328302f6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.729740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf435aa541a544b28e00f15005237289'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.736544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3562a5970a914d00957bce61328302f6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.742303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf435aa541a544b28e00f15005237289'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.749441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf435aa541a544b28e00f15005237289'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.750195 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf435aa541a544b28e00f15005237289'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.825275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3562a5970a914d00957bce61328302f6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.825994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8c9e726e-843a-42ca-a5fc-925065d66288 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3562a5970a914d00957bce61328302f6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.833285 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 982/1961] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:23 2021] DELETE /identity/v3/users/3562a5970a914d00957bce61328302f6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:23.915622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf435aa541a544b28e00f15005237289'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:23.932209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 980/1962] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:23 2021] DELETE /identity/v3/users/cf435aa541a544b28e00f15005237289 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:23.937738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8216-20a6-4a02-b224-f42745aa0460 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:23.938056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8216-20a6-4a02-b224-f42745aa0460 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:23.938326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b8216-20a6-4a02-b224-f42745aa0460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:23.968021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-667b8216-20a6-4a02-b224-f42745aa0460 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:23.969292 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-667b8216-20a6-4a02-b224-f42745aa0460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:24.032759 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 983/1963] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:23 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:24.043300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.045969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:24.090633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8216-20a6-4a02-b224-f42745aa0460 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.093010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-667b8216-20a6-4a02-b224-f42745aa0460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:24.105671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b8216-20a6-4a02-b224-f42745aa0460 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.110823 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.111824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.112111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.112386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] PATH_INFO: `/v3/users/bc03fcc11ac3464aa1bd60833a23a3e3` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.113812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc03fcc11ac3464aa1bd60833a23a3e3)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:24.116613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:24.123798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4cdc39-42ac-4c57-8c6e-25b153b37fd9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.128701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21532804-168c-493b-b703-b98cef3ce77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.129532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532804-168c-493b-b703-b98cef3ce77d service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.130014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532804-168c-493b-b703-b98cef3ce77d service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.130386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21532804-168c-493b-b703-b98cef3ce77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.141533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21532804-168c-493b-b703-b98cef3ce77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:24.143354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21532804-168c-493b-b703-b98cef3ce77d service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:24.153994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 981/1964] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:24.318067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc03fcc11ac3464aa1bd60833a23a3e3'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:24.330002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc03fcc11ac3464aa1bd60833a23a3e3'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:24.337024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc03fcc11ac3464aa1bd60833a23a3e3'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:24.380724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21532804-168c-493b-b703-b98cef3ce77d service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.382479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-21532804-168c-493b-b703-b98cef3ce77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:24.396393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21532804-168c-493b-b703-b98cef3ce77d service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.401361 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.401897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc03fcc11ac3464aa1bd60833a23a3e3'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:24.402454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.402741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.403560 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] PATH_INFO: `/v3/projects/0f1a30cf0d3641548271e3507f22eb0b` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.403670 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-866c1d0b-6ad5-4ba1-964e-750bd02b709f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc03fcc11ac3464aa1bd60833a23a3e3'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:24.404535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f1a30cf0d3641548271e3507f22eb0b)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:24.407422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:24.422231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 984/1965] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:24 2021] DELETE /identity/v3/users/bc03fcc11ac3464aa1bd60833a23a3e3 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:24.423694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39562fc-7066-4677-b1a0-f78e28c8d060 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.424049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39562fc-7066-4677-b1a0-f78e28c8d060 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.424442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39562fc-7066-4677-b1a0-f78e28c8d060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.446465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-a39562fc-7066-4677-b1a0-f78e28c8d060 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:24.448017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a39562fc-7066-4677-b1a0-f78e28c8d060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:24.517197 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 985/1966] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:24.528281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39562fc-7066-4677-b1a0-f78e28c8d060 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:24.529728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a39562fc-7066-4677-b1a0-f78e28c8d060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:24.541638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f1a30cf0d3641548271e3507f22eb0b', 'request_id': 'req-e61b6a98-72bc-403f-837f-3384c249dd64'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:24.548112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f1a30cf0d3641548271e3507f22eb0b', 'request_id': 'req-e61b6a98-72bc-403f-837f-3384c249dd64'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:24.568051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f1a30cf0d3641548271e3507f22eb0b', 'request_id': 'req-e61b6a98-72bc-403f-837f-3384c249dd64'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:24.610601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39562fc-7066-4677-b1a0-f78e28c8d060 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:24.661441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfca7e-c51a-45e0-96f5-5654273d0265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:24.662221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfca7e-c51a-45e0-96f5-5654273d0265 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:24.662564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfca7e-c51a-45e0-96f5-5654273d0265 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:24.663205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfca7e-c51a-45e0-96f5-5654273d0265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:24.717072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] The token cache is being invalidate because project 0f1a30cf0d3641548271e3507f22eb0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:25.009272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.009272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e61b6a98-72bc-403f-837f-3384c249dd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.009272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 982/1967] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:24 2021] DELETE /identity/v3/projects/0f1a30cf0d3641548271e3507f22eb0b => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:25.011063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfca7e-c51a-45e0-96f5-5654273d0265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.011063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfca7e-c51a-45e0-96f5-5654273d0265 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.011063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 986/1968] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:24 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:25.011615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90051364-2b4e-4d25-b7d6-ba47f98611c0 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.011615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90051364-2b4e-4d25-b7d6-ba47f98611c0 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.011615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90051364-2b4e-4d25-b7d6-ba47f98611c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.011615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-90051364-2b4e-4d25-b7d6-ba47f98611c0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:25.011615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-90051364-2b4e-4d25-b7d6-ba47f98611c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:25.011615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 983/1969] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:25.012241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98430a37-f5a7-4591-a75c-69db96b9d1a5 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.012241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98430a37-f5a7-4591-a75c-69db96b9d1a5 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.012241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98430a37-f5a7-4591-a75c-69db96b9d1a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.012241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-98430a37-f5a7-4591-a75c-69db96b9d1a5 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:25.012241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-98430a37-f5a7-4591-a75c-69db96b9d1a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:25.012241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 987/1970] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:25.016784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90051364-2b4e-4d25-b7d6-ba47f98611c0 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.026893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90051364-2b4e-4d25-b7d6-ba47f98611c0 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.041241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.041241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.041241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.041241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.041615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:25.041615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.041615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.046926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 984/1971] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:25.051286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98430a37-f5a7-4591-a75c-69db96b9d1a5 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.060533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98430a37-f5a7-4591-a75c-69db96b9d1a5 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.065360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd203-0357-41d2-a22e-d9cdbaa4d0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.066009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd203-0357-41d2-a22e-d9cdbaa4d0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.066314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd203-0357-41d2-a22e-d9cdbaa4d0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.066585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3fd203-0357-41d2-a22e-d9cdbaa4d0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.067342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd203-0357-41d2-a22e-d9cdbaa4d0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.069209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3fd203-0357-41d2-a22e-d9cdbaa4d0c0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.222576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.224225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:25.240814 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e2e66-c3b4-4465-bb1e-85b868c0a4af admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.248091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.251324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.251324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.251324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] PATH_INFO: `/v3/projects/7dc56696bc054c3a8eeb9826505d203f` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.251324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dc56696bc054c3a8eeb9826505d203f)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.252955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.408086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 988/1972] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:25 2021] POST /identity/v3/projects => generated 373 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:25.412116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd203-0357-41d2-a22e-d9cdbaa4d0c0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.470774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dc56696bc054c3a8eeb9826505d203f', 'request_id': 'req-d5b2417e-1552-4b5a-9e4a-c04573a1932e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.473557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3fd203-0357-41d2-a22e-d9cdbaa4d0c0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.478683 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dc56696bc054c3a8eeb9826505d203f', 'request_id': 'req-d5b2417e-1552-4b5a-9e4a-c04573a1932e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.484375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dc56696bc054c3a8eeb9826505d203f', 'request_id': 'req-d5b2417e-1552-4b5a-9e4a-c04573a1932e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.548359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eacd96-8568-448a-82e5-1c554a9b155f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.549224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eacd96-8568-448a-82e5-1c554a9b155f admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.549506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eacd96-8568-448a-82e5-1c554a9b155f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.549829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eacd96-8568-448a-82e5-1c554a9b155f admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.550580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eacd96-8568-448a-82e5-1c554a9b155f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.552684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eacd96-8568-448a-82e5-1c554a9b155f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.556528 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] The token cache is being invalidate because project 7dc56696bc054c3a8eeb9826505d203f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:25.556810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.557760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.559335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 985/1973] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:25 2021] DELETE /identity/v3/projects/7dc56696bc054c3a8eeb9826505d203f => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:25.569220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.569220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:25.581359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b2417e-1552-4b5a-9e4a-c04573a1932e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.586542 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.587746 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.588026 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.588524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] PATH_INFO: `/v3/users/6a41c663e4044b99aa1f35cb88410d0c` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.589971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a41c663e4044b99aa1f35cb88410d0c)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.591931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.662476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 989/1974] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:25 2021] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:25.663752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eacd96-8568-448a-82e5-1c554a9b155f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.666508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-27eacd96-8568-448a-82e5-1c554a9b155f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:25.681414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eacd96-8568-448a-82e5-1c554a9b155f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.686813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516aeb5-a6ce-4acf-bd8e-6f0785a840bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.687507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516aeb5-a6ce-4acf-bd8e-6f0785a840bb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.687792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516aeb5-a6ce-4acf-bd8e-6f0785a840bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.688065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d516aeb5-a6ce-4acf-bd8e-6f0785a840bb admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.688803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516aeb5-a6ce-4acf-bd8e-6f0785a840bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.690435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d516aeb5-a6ce-4acf-bd8e-6f0785a840bb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.700811 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 990/1975] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:25.704651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516aeb5-a6ce-4acf-bd8e-6f0785a840bb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.715209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d516aeb5-a6ce-4acf-bd8e-6f0785a840bb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.720003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b0fe2-7454-42f2-88c0-66fe6cdf33b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.723560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b0fe2-7454-42f2-88c0-66fe6cdf33b2 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.723560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b0fe2-7454-42f2-88c0-66fe6cdf33b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.723560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b0fe2-7454-42f2-88c0-66fe6cdf33b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.723560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b0fe2-7454-42f2-88c0-66fe6cdf33b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.723892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b0fe2-7454-42f2-88c0-66fe6cdf33b2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.738629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 991/1976] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:25 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:25.739536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b0fe2-7454-42f2-88c0-66fe6cdf33b2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.749676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b0fe2-7454-42f2-88c0-66fe6cdf33b2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.754402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28352df0-5d36-4b88-988f-ac081c6d4b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.761698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352df0-5d36-4b88-988f-ac081c6d4b10 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.761698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352df0-5d36-4b88-988f-ac081c6d4b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.761698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28352df0-5d36-4b88-988f-ac081c6d4b10 admin admin] PATH_INFO: `/v3/projects/e093f4259be443e4bf66194aff0e408f/users/283c4b50a6a74a2685e0a05293bc369c/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.771696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28352df0-5d36-4b88-988f-ac081c6d4b10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e093f4259be443e4bf66194aff0e408f, user_id=283c4b50a6a74a2685e0a05293bc369c, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.774802 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28352df0-5d36-4b88-988f-ac081c6d4b10 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.807320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a41c663e4044b99aa1f35cb88410d0c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.819765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a41c663e4044b99aa1f35cb88410d0c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.827143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a41c663e4044b99aa1f35cb88410d0c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.827823 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a41c663e4044b99aa1f35cb88410d0c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.846782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 992/1977] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:25 2021] PUT /identity/v3/projects/e093f4259be443e4bf66194aff0e408f/users/283c4b50a6a74a2685e0a05293bc369c/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:25.847838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28352df0-5d36-4b88-988f-ac081c6d4b10 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:25.849494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-28352df0-5d36-4b88-988f-ac081c6d4b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:25.909972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-53752957-61ee-49b9-b008-aa8f5644fa20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a41c663e4044b99aa1f35cb88410d0c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:25.912127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28352df0-5d36-4b88-988f-ac081c6d4b10 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:25.916793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 986/1978] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:25 2021] DELETE /identity/v3/users/6a41c663e4044b99aa1f35cb88410d0c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:25.918339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797cfaf-6d13-4020-b958-c42ea20cd44d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.918525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:25.919019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797cfaf-6d13-4020-b958-c42ea20cd44d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.919475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8797cfaf-6d13-4020-b958-c42ea20cd44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.922284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:25.922719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:25.928244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] PATH_INFO: `/v3/projects/d18990ef0fb945dba805b8bdee85a240` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:25.928244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18990ef0fb945dba805b8bdee85a240)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:25.928244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:25.941907 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8797cfaf-6d13-4020-b958-c42ea20cd44d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:25.943507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8797cfaf-6d13-4020-b958-c42ea20cd44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:26.022151 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 987/1979] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:25 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:26.037118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797cfaf-6d13-4020-b958-c42ea20cd44d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:26.040073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8797cfaf-6d13-4020-b958-c42ea20cd44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:26.078575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18990ef0fb945dba805b8bdee85a240', 'request_id': 'req-51800bda-c1f1-4a7d-a359-a66b4a36cc36'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.085046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18990ef0fb945dba805b8bdee85a240', 'request_id': 'req-51800bda-c1f1-4a7d-a359-a66b4a36cc36'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.091691 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18990ef0fb945dba805b8bdee85a240', 'request_id': 'req-51800bda-c1f1-4a7d-a359-a66b4a36cc36'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.106474 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8797cfaf-6d13-4020-b958-c42ea20cd44d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:26.155710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecff4d4-24d9-4811-9ea8-8b2f8d2481f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:26.156485 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff4d4-24d9-4811-9ea8-8b2f8d2481f6 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:26.156655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff4d4-24d9-4811-9ea8-8b2f8d2481f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:26.156929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecff4d4-24d9-4811-9ea8-8b2f8d2481f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:26.167943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] The token cache is being invalidate because project d18990ef0fb945dba805b8bdee85a240 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:26.168442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.175854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.175854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 993/1980] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:25 2021] DELETE /identity/v3/projects/d18990ef0fb945dba805b8bdee85a240 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:26.176978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:26.179302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:26.235577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecff4d4-24d9-4811-9ea8-8b2f8d2481f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:26.237041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecff4d4-24d9-4811-9ea8-8b2f8d2481f6 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:26.250337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 988/1981] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:26 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:26.251216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecff4d4-24d9-4811-9ea8-8b2f8d2481f6 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:26.254378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-eecff4d4-24d9-4811-9ea8-8b2f8d2481f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:26.267567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51800bda-c1f1-4a7d-a359-a66b4a36cc36 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:26.269592 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecff4d4-24d9-4811-9ea8-8b2f8d2481f6 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:26.273894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:26.275182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:26.275466 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:26.275744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] PATH_INFO: `/v3/users/6ef5d4e73f764b9cb58f0f176a1dfb65` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:26.276536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:26.278003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ef5d4e73f764b9cb58f0f176a1dfb65)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:26.278152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:26.278152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:26.278152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] PATH_INFO: `/v3/users/b11b35bf64df44739ab333b4f130d23a` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:26.279290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b11b35bf64df44739ab333b4f130d23a)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:26.279799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:26.281864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:26.484169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b11b35bf64df44739ab333b4f130d23a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.495563 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b11b35bf64df44739ab333b4f130d23a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.502112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b11b35bf64df44739ab333b4f130d23a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.502776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b11b35bf64df44739ab333b4f130d23a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.523140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ef5d4e73f764b9cb58f0f176a1dfb65'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.535154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ef5d4e73f764b9cb58f0f176a1dfb65'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.542411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ef5d4e73f764b9cb58f0f176a1dfb65'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.580209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b11b35bf64df44739ab333b4f130d23a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.588200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 989/1982] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:26 2021] DELETE /identity/v3/users/b11b35bf64df44739ab333b4f130d23a => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:26.592021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:26.593401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:26.647708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ef5d4e73f764b9cb58f0f176a1dfb65'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.649113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ef5d4e73f764b9cb58f0f176a1dfb65'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.658222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 994/1983] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:26 2021] DELETE /identity/v3/users/6ef5d4e73f764b9cb58f0f176a1dfb65 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:26.668425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693e367-ade1-49ed-a8d8-470f238d8ee3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:26.745411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:26.747112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:26.747639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:26.748082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] PATH_INFO: `/v3/projects/292414df5882486183e1bbd6ae384885` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:26.750451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] RBAC: Authorizing `identity:delete_project(project_id=292414df5882486183e1bbd6ae384885)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:26.753136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:26.884989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:26.886723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:26.906136 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0b3cc3-cb0c-4546-b970-d032ef9cff0d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:26.920089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '292414df5882486183e1bbd6ae384885', 'request_id': 'req-49b98310-bc62-4658-bc49-f4e587bf28da'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.926572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '292414df5882486183e1bbd6ae384885', 'request_id': 'req-49b98310-bc62-4658-bc49-f4e587bf28da'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.932068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '292414df5882486183e1bbd6ae384885', 'request_id': 'req-49b98310-bc62-4658-bc49-f4e587bf28da'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:26.969794 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:26.970922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:26.973209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:26.973209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] PATH_INFO: `/v3/projects/341b274900784c5f8f6e3b7f10f80cc8` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:26.973209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=341b274900784c5f8f6e3b7f10f80cc8)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:26.975072 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.047671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] The token cache is being invalidate because project 292414df5882486183e1bbd6ae384885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:27.047931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.048717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-49b98310-bc62-4658-bc49-f4e587bf28da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.050406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 990/1984] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:26 2021] DELETE /identity/v3/projects/292414df5882486183e1bbd6ae384885 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:27.056693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ec62a-52e5-4845-8ce6-820afcf9579f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.056977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ec62a-52e5-4845-8ce6-820afcf9579f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.057317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2ec62a-52e5-4845-8ce6-820afcf9579f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.097663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8e2ec62a-52e5-4845-8ce6-820afcf9579f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:27.099520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8e2ec62a-52e5-4845-8ce6-820afcf9579f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.109640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341b274900784c5f8f6e3b7f10f80cc8', 'request_id': 'req-a6664cad-8947-48c3-b0f7-88fbdbe567ef'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.121234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341b274900784c5f8f6e3b7f10f80cc8', 'request_id': 'req-a6664cad-8947-48c3-b0f7-88fbdbe567ef'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.136125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341b274900784c5f8f6e3b7f10f80cc8', 'request_id': 'req-a6664cad-8947-48c3-b0f7-88fbdbe567ef'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.196982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 991/1985] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:27.204579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e0eb-44d5-436a-85c3-f26743dc9a5e None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.204882 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e0eb-44d5-436a-85c3-f26743dc9a5e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.205135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5e0eb-44d5-436a-85c3-f26743dc9a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.229170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-73b5e0eb-44d5-436a-85c3-f26743dc9a5e None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:27.230365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] The token cache is being invalidate because project 341b274900784c5f8f6e3b7f10f80cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:27.230519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-73b5e0eb-44d5-436a-85c3-f26743dc9a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.230697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.232067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.235313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 995/1986] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:26 2021] DELETE /identity/v3/projects/341b274900784c5f8f6e3b7f10f80cc8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:27.236104 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.239745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.246091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 992/1987] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:27.246981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e0eb-44d5-436a-85c3-f26743dc9a5e None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.261300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5e0eb-44d5-436a-85c3-f26743dc9a5e None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.268861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b688789-cc85-4ac0-9def-f010f4d9feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.275304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b688789-cc85-4ac0-9def-f010f4d9feb6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.276242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b688789-cc85-4ac0-9def-f010f4d9feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.276694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b688789-cc85-4ac0-9def-f010f4d9feb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.277856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b688789-cc85-4ac0-9def-f010f4d9feb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:27.278294 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b688789-cc85-4ac0-9def-f010f4d9feb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.280983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b688789-cc85-4ac0-9def-f010f4d9feb6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.282750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6664cad-8947-48c3-b0f7-88fbdbe567ef admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.290080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.290947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.291222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.291491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] PATH_INFO: `/v3/projects/b233cff3fff348d5b8b512554a65cbe9` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.292783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b233cff3fff348d5b8b512554a65cbe9)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.294882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.299101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 993/1988] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:27.299101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0d783-43ca-4534-9078-34d382b24711 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.299101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0d783-43ca-4534-9078-34d382b24711 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.299101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0d783-43ca-4534-9078-34d382b24711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.323213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-a1f0d783-43ca-4534-9078-34d382b24711 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:27.324436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a1f0d783-43ca-4534-9078-34d382b24711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.334539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 994/1989] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:27.335382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0d783-43ca-4534-9078-34d382b24711 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.349200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0d783-43ca-4534-9078-34d382b24711 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.361402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148093ed-fe2a-4cd0-9404-b30b128ffd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.361402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148093ed-fe2a-4cd0-9404-b30b128ffd7e admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.361402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148093ed-fe2a-4cd0-9404-b30b128ffd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.361402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148093ed-fe2a-4cd0-9404-b30b128ffd7e admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.361701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148093ed-fe2a-4cd0-9404-b30b128ffd7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.361701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148093ed-fe2a-4cd0-9404-b30b128ffd7e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.385868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b233cff3fff348d5b8b512554a65cbe9', 'request_id': 'req-b29f51d4-4987-4179-a673-07288822a8ce'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.392454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b233cff3fff348d5b8b512554a65cbe9', 'request_id': 'req-b29f51d4-4987-4179-a673-07288822a8ce'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.397831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b233cff3fff348d5b8b512554a65cbe9', 'request_id': 'req-b29f51d4-4987-4179-a673-07288822a8ce'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.431571 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 995/1990] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:27.433195 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b040-2783-4b1d-9ea4-0d6daad3b914 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.433653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b040-2783-4b1d-9ea4-0d6daad3b914 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.434150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2b040-2783-4b1d-9ea4-0d6daad3b914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.457099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-18d2b040-2783-4b1d-9ea4-0d6daad3b914 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:27.458322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-18d2b040-2783-4b1d-9ea4-0d6daad3b914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.472532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] The token cache is being invalidate because project b233cff3fff348d5b8b512554a65cbe9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:27.476429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.476429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:27.476429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 996/1991] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:27 2021] DELETE /identity/v3/projects/b233cff3fff348d5b8b512554a65cbe9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:27.476429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.479433 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.542169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 996/1992] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:27.546151 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec463c2-9cf6-4956-95df-2e26ef951e76 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.547310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec463c2-9cf6-4956-95df-2e26ef951e76 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.549188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec463c2-9cf6-4956-95df-2e26ef951e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.570216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-eec463c2-9cf6-4956-95df-2e26ef951e76 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:27.573052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-eec463c2-9cf6-4956-95df-2e26ef951e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.573193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f51d4-4987-4179-a673-07288822a8ce admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.577600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44738f-d413-4b11-acc8-14460087873d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.602169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44738f-d413-4b11-acc8-14460087873d admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.602169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44738f-d413-4b11-acc8-14460087873d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.602169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44738f-d413-4b11-acc8-14460087873d admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.602169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44738f-d413-4b11-acc8-14460087873d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.602569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 997/1993] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:27.602699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44738f-d413-4b11-acc8-14460087873d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.602842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec463c2-9cf6-4956-95df-2e26ef951e76 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.602842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec463c2-9cf6-4956-95df-2e26ef951e76 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.602842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fc6f-38ef-4b9b-9d8c-cbffe6135ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.602842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fc6f-38ef-4b9b-9d8c-cbffe6135ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.603180 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fc6f-38ef-4b9b-9d8c-cbffe6135ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.603459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173fc6f-38ef-4b9b-9d8c-cbffe6135ab4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.604215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173fc6f-38ef-4b9b-9d8c-cbffe6135ab4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:27.605254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173fc6f-38ef-4b9b-9d8c-cbffe6135ab4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.606183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173fc6f-38ef-4b9b-9d8c-cbffe6135ab4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.622090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 998/1994] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:27.626988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fc6f-38ef-4b9b-9d8c-cbffe6135ab4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.637854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173fc6f-38ef-4b9b-9d8c-cbffe6135ab4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.642480 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54e32d-0173-4ad0-a280-e37ab428bc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.643163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54e32d-0173-4ad0-a280-e37ab428bc12 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.643444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54e32d-0173-4ad0-a280-e37ab428bc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.643717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae54e32d-0173-4ad0-a280-e37ab428bc12 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.644466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54e32d-0173-4ad0-a280-e37ab428bc12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.646326 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae54e32d-0173-4ad0-a280-e37ab428bc12 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.683019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 997/1995] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/users => generated 295 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:27.684305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7b4db-ef1c-4a24-bdf8-ffde5cfc9715 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.684589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7b4db-ef1c-4a24-bdf8-ffde5cfc9715 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.684860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b7b4db-ef1c-4a24-bdf8-ffde5cfc9715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.704438 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d0b7b4db-ef1c-4a24-bdf8-ffde5cfc9715 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:27.705677 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d0b7b4db-ef1c-4a24-bdf8-ffde5cfc9715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.713595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 998/1996] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:27.714483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7b4db-ef1c-4a24-bdf8-ffde5cfc9715 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.723584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b7b4db-ef1c-4a24-bdf8-ffde5cfc9715 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.728419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed737396-13c9-44d9-81be-3e8a5e00ab2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.729060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed737396-13c9-44d9-81be-3e8a5e00ab2d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.729338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed737396-13c9-44d9-81be-3e8a5e00ab2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.729608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed737396-13c9-44d9-81be-3e8a5e00ab2d admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.730401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed737396-13c9-44d9-81be-3e8a5e00ab2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.731974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed737396-13c9-44d9-81be-3e8a5e00ab2d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.741724 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 999/1997] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:27.743127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed737396-13c9-44d9-81be-3e8a5e00ab2d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.754226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 999/1998] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/projects => generated 363 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:27.755097 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54e32d-0173-4ad0-a280-e37ab428bc12 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.758620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed737396-13c9-44d9-81be-3e8a5e00ab2d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.820296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6c945-c9b1-4050-b640-8d7066d062e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.821003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6c945-c9b1-4050-b640-8d7066d062e4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.821408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae54e32d-0173-4ad0-a280-e37ab428bc12 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.821529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6c945-c9b1-4050-b640-8d7066d062e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.821709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f6c945-c9b1-4050-b640-8d7066d062e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.822486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6c945-c9b1-4050-b640-8d7066d062e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:27.822885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6c945-c9b1-4050-b640-8d7066d062e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.826398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55513eb-6823-4ae6-998d-44a12fcbfb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.828746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f6c945-c9b1-4050-b640-8d7066d062e4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.830670 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55513eb-6823-4ae6-998d-44a12fcbfb68 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.831726 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55513eb-6823-4ae6-998d-44a12fcbfb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.832159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55513eb-6823-4ae6-998d-44a12fcbfb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.833203 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55513eb-6823-4ae6-998d-44a12fcbfb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.835173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55513eb-6823-4ae6-998d-44a12fcbfb68 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.842884 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1000/1999] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:27.843495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6c945-c9b1-4050-b640-8d7066d062e4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.850254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1000/2000] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:27 2021] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:27.853014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb594e71-9589-4761-94cd-89433cb55871 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.853669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb594e71-9589-4761-94cd-89433cb55871 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.854179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb594e71-9589-4761-94cd-89433cb55871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.855003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f6c945-c9b1-4050-b640-8d7066d062e4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.860528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1865e-6ee4-48ef-9bfc-07e93add090d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.861164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1865e-6ee4-48ef-9bfc-07e93add090d admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.861444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1865e-6ee4-48ef-9bfc-07e93add090d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.861714 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed1865e-6ee4-48ef-9bfc-07e93add090d admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.862695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1865e-6ee4-48ef-9bfc-07e93add090d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.864381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed1865e-6ee4-48ef-9bfc-07e93add090d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.886347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-bb594e71-9589-4761-94cd-89433cb55871 None None] MFA Rules not processed for user `283c4b50a6a74a2685e0a05293bc369c`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:27.886709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-bb594e71-9589-4761-94cd-89433cb55871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:27.952057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1001/2001] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:27.953600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb594e71-9589-4761-94cd-89433cb55871 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.958222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1001/2002] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/users => generated 282 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:27.958222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1865e-6ee4-48ef-9bfc-07e93add090d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:27.967763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb594e71-9589-4761-94cd-89433cb55871 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.968595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed1865e-6ee4-48ef-9bfc-07e93add090d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:27.973698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196a6ed-184c-49e8-acb3-dbb2619e145f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.974668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33aac9-5bce-4b54-9b56-58a243dce65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:27.974789 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a6ed-184c-49e8-acb3-dbb2619e145f admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.974981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a6ed-184c-49e8-acb3-dbb2619e145f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.975359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f196a6ed-184c-49e8-acb3-dbb2619e145f admin admin] PATH_INFO: `/v3/projects/6448ca2c87974a60b23c8d8ab52f13d8/users/0b4f4402f2cc410a9fcb771b4cd75420/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.976234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33aac9-5bce-4b54-9b56-58a243dce65e admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:27.976514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33aac9-5bce-4b54-9b56-58a243dce65e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:27.977446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b33aac9-5bce-4b54-9b56-58a243dce65e admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:27.978081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33aac9-5bce-4b54-9b56-58a243dce65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:27.980104 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b33aac9-5bce-4b54-9b56-58a243dce65e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:27.991909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196a6ed-184c-49e8-acb3-dbb2619e145f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6448ca2c87974a60b23c8d8ab52f13d8, user_id=0b4f4402f2cc410a9fcb771b4cd75420, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.000882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f196a6ed-184c-49e8-acb3-dbb2619e145f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.059445 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1002/2003] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:27 2021] PUT /identity/v3/projects/6448ca2c87974a60b23c8d8ab52f13d8/users/0b4f4402f2cc410a9fcb771b4cd75420/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:28.064058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196a6ed-184c-49e8-acb3-dbb2619e145f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.064058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f196a6ed-184c-49e8-acb3-dbb2619e145f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:28.077055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1002/2004] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:27 2021] POST /identity/v3/projects => generated 381 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:28.079099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33aac9-5bce-4b54-9b56-58a243dce65e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.126238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f196a6ed-184c-49e8-acb3-dbb2619e145f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.140326 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b33aac9-5bce-4b54-9b56-58a243dce65e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.144989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717355d9-e35f-4e42-b1e6-61e7a7dcf938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.145671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717355d9-e35f-4e42-b1e6-61e7a7dcf938 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.145943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717355d9-e35f-4e42-b1e6-61e7a7dcf938 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.151497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717355d9-e35f-4e42-b1e6-61e7a7dcf938 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.151497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717355d9-e35f-4e42-b1e6-61e7a7dcf938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.151497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717355d9-e35f-4e42-b1e6-61e7a7dcf938 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.162399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1003/2005] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:28.162399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa08f5-5945-46b0-bc64-e22b92dd0461 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.162399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa08f5-5945-46b0-bc64-e22b92dd0461 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.162399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fa08f5-5945-46b0-bc64-e22b92dd0461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.181968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2257a8b-d156-43c9-9227-770cc7c20a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.182730 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2257a8b-d156-43c9-9227-770cc7c20a5b admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.182977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2257a8b-d156-43c9-9227-770cc7c20a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.183256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2257a8b-d156-43c9-9227-770cc7c20a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.183986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2257a8b-d156-43c9-9227-770cc7c20a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.186821 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2257a8b-d156-43c9-9227-770cc7c20a5b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.188983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-28fa08f5-5945-46b0-bc64-e22b92dd0461 None None] MFA Rules not processed for user `0b4f4402f2cc410a9fcb771b4cd75420`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:28.190205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-28fa08f5-5945-46b0-bc64-e22b92dd0461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:28.251795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1004/2006] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:28 2021] POST /identity/v3/auth/tokens => generated 3409 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:28.252680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa08f5-5945-46b0-bc64-e22b92dd0461 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.263215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fa08f5-5945-46b0-bc64-e22b92dd0461 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.267885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8f4a2-4fba-4b99-a5ec-0a3d5dd42a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.268528 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8f4a2-4fba-4b99-a5ec-0a3d5dd42a4e admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.268810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8f4a2-4fba-4b99-a5ec-0a3d5dd42a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.269078 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8f4a2-4fba-4b99-a5ec-0a3d5dd42a4e admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.269774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8f4a2-4fba-4b99-a5ec-0a3d5dd42a4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.271695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8f4a2-4fba-4b99-a5ec-0a3d5dd42a4e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.315757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1003/2007] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:28 2021] POST /identity/v3/projects => generated 373 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:28.315757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2257a8b-d156-43c9-9227-770cc7c20a5b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.364981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1005/2008] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:28 2021] POST /identity/v3/users => generated 291 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:28.364981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8f4a2-4fba-4b99-a5ec-0a3d5dd42a4e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.373409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8f4a2-4fba-4b99-a5ec-0a3d5dd42a4e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.389093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2257a8b-d156-43c9-9227-770cc7c20a5b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.394809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dedf1-8457-47b2-b016-77c6e36e219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.395481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dedf1-8457-47b2-b016-77c6e36e219f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.395760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dedf1-8457-47b2-b016-77c6e36e219f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.396028 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900dedf1-8457-47b2-b016-77c6e36e219f admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.396769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dedf1-8457-47b2-b016-77c6e36e219f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.398387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900dedf1-8457-47b2-b016-77c6e36e219f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.414352 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1004/2009] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:28.415727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dedf1-8457-47b2-b016-77c6e36e219f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.428184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900dedf1-8457-47b2-b016-77c6e36e219f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.434768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039e8c-2b77-4934-b326-6a64087e8c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.435625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039e8c-2b77-4934-b326-6a64087e8c7a admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.435968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039e8c-2b77-4934-b326-6a64087e8c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.436306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c039e8c-2b77-4934-b326-6a64087e8c7a admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.437083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c039e8c-2b77-4934-b326-6a64087e8c7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.438017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179971a4-3e64-4afc-ba22-33e1a9e18fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.438933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179971a4-3e64-4afc-ba22-33e1a9e18fec admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.439284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c039e8c-2b77-4934-b326-6a64087e8c7a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.439405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179971a4-3e64-4afc-ba22-33e1a9e18fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.439583 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179971a4-3e64-4afc-ba22-33e1a9e18fec admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.440250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179971a4-3e64-4afc-ba22-33e1a9e18fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.442168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179971a4-3e64-4afc-ba22-33e1a9e18fec admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.537776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1005/2010] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:28 2021] POST /identity/v3/users => generated 293 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:28.538626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039e8c-2b77-4934-b326-6a64087e8c7a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.548562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c039e8c-2b77-4934-b326-6a64087e8c7a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.553071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e858a27-a223-4321-bed3-c114fa48c702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.553694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e858a27-a223-4321-bed3-c114fa48c702 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.553973 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e858a27-a223-4321-bed3-c114fa48c702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.554274 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e858a27-a223-4321-bed3-c114fa48c702 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.555250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e858a27-a223-4321-bed3-c114fa48c702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.556835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e858a27-a223-4321-bed3-c114fa48c702 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.564090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1006/2011] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:28 2021] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:28.564090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179971a4-3e64-4afc-ba22-33e1a9e18fec admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.571237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1006/2012] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:28.571237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e858a27-a223-4321-bed3-c114fa48c702 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.579812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e858a27-a223-4321-bed3-c114fa48c702 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.629437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179971a4-3e64-4afc-ba22-33e1a9e18fec admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.635084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d50b-87ce-44b0-b38f-a2c2f4bef9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.635918 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362630b-0c49-4a7a-ba08-12f2faeb8f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.636062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d50b-87ce-44b0-b38f-a2c2f4bef9f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.636301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d50b-87ce-44b0-b38f-a2c2f4bef9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.636570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8d50b-87ce-44b0-b38f-a2c2f4bef9f7 admin admin] PATH_INFO: `/v3/projects/ca27529e459e44b3b5cea41dc7ac819d/users/8107a80a978048f696d39ca0af37876f/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.636711 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362630b-0c49-4a7a-ba08-12f2faeb8f8e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.636993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362630b-0c49-4a7a-ba08-12f2faeb8f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.637258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362630b-0c49-4a7a-ba08-12f2faeb8f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.637986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362630b-0c49-4a7a-ba08-12f2faeb8f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.641688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362630b-0c49-4a7a-ba08-12f2faeb8f8e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.650563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1007/2013] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:28.650563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362630b-0c49-4a7a-ba08-12f2faeb8f8e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.661887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362630b-0c49-4a7a-ba08-12f2faeb8f8e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.669749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2386a-118b-4809-93c2-679141839179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.670816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2386a-118b-4809-93c2-679141839179 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.671200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2386a-118b-4809-93c2-679141839179 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.671646 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2386a-118b-4809-93c2-679141839179 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.672627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2386a-118b-4809-93c2-679141839179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.674762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2386a-118b-4809-93c2-679141839179 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.769513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1008/2014] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:28 2021] POST /identity/v3/users => generated 299 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:28.769513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2386a-118b-4809-93c2-679141839179 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.780514 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2386a-118b-4809-93c2-679141839179 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.785162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c2fc-bf66-49ca-b1ee-c34d0679aba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.785838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c2fc-bf66-49ca-b1ee-c34d0679aba5 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.786147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c2fc-bf66-49ca-b1ee-c34d0679aba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.786423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d4c2fc-bf66-49ca-b1ee-c34d0679aba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.787159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c2fc-bf66-49ca-b1ee-c34d0679aba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.788864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d4c2fc-bf66-49ca-b1ee-c34d0679aba5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.791246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8d50b-87ce-44b0-b38f-a2c2f4bef9f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca27529e459e44b3b5cea41dc7ac819d, user_id=8107a80a978048f696d39ca0af37876f, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.793829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a8d50b-87ce-44b0-b38f-a2c2f4bef9f7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.799154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1009/2015] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:28.800008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c2fc-bf66-49ca-b1ee-c34d0679aba5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.809518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d4c2fc-bf66-49ca-b1ee-c34d0679aba5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.814004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d3db-e28e-459f-b556-7a20332714d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.814875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d3db-e28e-459f-b556-7a20332714d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.815154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d3db-e28e-459f-b556-7a20332714d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.815423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf1d3db-e28e-459f-b556-7a20332714d6 admin admin] PATH_INFO: `/v3/projects/32623a2f72f14f469dbcc3d202f0453c/users/e325602fa35d4a5fbba0f82c88d12371/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.833773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1d3db-e28e-459f-b556-7a20332714d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32623a2f72f14f469dbcc3d202f0453c, user_id=e325602fa35d4a5fbba0f82c88d12371, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.836791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf1d3db-e28e-459f-b556-7a20332714d6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:28.864938 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1007/2016] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:28 2021] PUT /identity/v3/projects/ca27529e459e44b3b5cea41dc7ac819d/users/8107a80a978048f696d39ca0af37876f/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:28.865784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d50b-87ce-44b0-b38f-a2c2f4bef9f7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.867839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a1a8d50b-87ce-44b0-b38f-a2c2f4bef9f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:28.933484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1010/2017] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:28 2021] PUT /identity/v3/projects/32623a2f72f14f469dbcc3d202f0453c/users/e325602fa35d4a5fbba0f82c88d12371/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:28.934482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d3db-e28e-459f-b556-7a20332714d6 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:28.939522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a8d50b-87ce-44b0-b38f-a2c2f4bef9f7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.994391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf1d3db-e28e-459f-b556-7a20332714d6 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:28.995487 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:28.996461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:28.996928 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:28.997368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] PATH_INFO: `/v3/users/87464ccd3ccf4238a210c6f628011444` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:28.998824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87464ccd3ccf4238a210c6f628011444)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:28.999652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe6a1f-2ef1-4340-951d-6e11d50ccc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.000319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe6a1f-2ef1-4340-951d-6e11d50ccc14 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.000603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe6a1f-2ef1-4340-951d-6e11d50ccc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.000881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe6a1f-2ef1-4340-951d-6e11d50ccc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.000997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.001625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe6a1f-2ef1-4340-951d-6e11d50ccc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.003241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffe6a1f-2ef1-4340-951d-6e11d50ccc14 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.015109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1011/2018] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:28 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:29.016263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe6a1f-2ef1-4340-951d-6e11d50ccc14 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.026503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe6a1f-2ef1-4340-951d-6e11d50ccc14 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.031180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af001a00-4c64-4963-a1ba-b03bb7c3e430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.032056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af001a00-4c64-4963-a1ba-b03bb7c3e430 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.032338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af001a00-4c64-4963-a1ba-b03bb7c3e430 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.032615 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af001a00-4c64-4963-a1ba-b03bb7c3e430 admin admin] PATH_INFO: `/v3/projects/e2a61a6a983d40a892e86265ea53e264/users/7c337cd5d6584422a8ac0ee3d3f9fd81/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.047108 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af001a00-4c64-4963-a1ba-b03bb7c3e430 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2a61a6a983d40a892e86265ea53e264, user_id=7c337cd5d6584422a8ac0ee3d3f9fd81, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.049681 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af001a00-4c64-4963-a1ba-b03bb7c3e430 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.144290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1012/2019] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:29 2021] PUT /identity/v3/projects/e2a61a6a983d40a892e86265ea53e264/users/7c337cd5d6584422a8ac0ee3d3f9fd81/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:29.145848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6f54-4aed-4c88-88ca-3b8186a55d42 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.146171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6f54-4aed-4c88-88ca-3b8186a55d42 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.146449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb6f54-4aed-4c88-88ca-3b8186a55d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.173773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-89cb6f54-4aed-4c88-88ca-3b8186a55d42 None None] MFA Rules not processed for user `8107a80a978048f696d39ca0af37876f`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:29.174606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87464ccd3ccf4238a210c6f628011444'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:29.175130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-89cb6f54-4aed-4c88-88ca-3b8186a55d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:29.187091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87464ccd3ccf4238a210c6f628011444'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:29.193557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87464ccd3ccf4238a210c6f628011444'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:29.194253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87464ccd3ccf4238a210c6f628011444'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:29.305550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87464ccd3ccf4238a210c6f628011444'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:29.312805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1008/2020] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:28 2021] DELETE /identity/v3/users/87464ccd3ccf4238a210c6f628011444 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:29.313573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.315146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:29.366145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1013/2021] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:29 2021] POST /identity/v3/auth/tokens => generated 3383 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:29.366974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6f54-4aed-4c88-88ca-3b8186a55d42 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.371758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-89cb6f54-4aed-4c88-88ca-3b8186a55d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:29.379317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d605707b-355c-412c-a63c-2e1fc591a255 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.384439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575de60-2008-4cae-a29e-0fae34545603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.385232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575de60-2008-4cae-a29e-0fae34545603 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.385664 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575de60-2008-4cae-a29e-0fae34545603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.385943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575de60-2008-4cae-a29e-0fae34545603 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.386801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575de60-2008-4cae-a29e-0fae34545603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.388498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575de60-2008-4cae-a29e-0fae34545603 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.399257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1009/2022] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:29 2021] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:29.401474 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50044b11-1736-4992-9b38-ac430bb9d9bd None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.401925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50044b11-1736-4992-9b38-ac430bb9d9bd None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.402257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50044b11-1736-4992-9b38-ac430bb9d9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.429374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-50044b11-1736-4992-9b38-ac430bb9d9bd None None] MFA Rules not processed for user `7c337cd5d6584422a8ac0ee3d3f9fd81`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:29.430696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-50044b11-1736-4992-9b38-ac430bb9d9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:29.434441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb6f54-4aed-4c88-88ca-3b8186a55d42 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.438986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976bdf9-1ba7-4724-84dc-03b3212ca698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.439870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976bdf9-1ba7-4724-84dc-03b3212ca698 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.440139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976bdf9-1ba7-4724-84dc-03b3212ca698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.440406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b976bdf9-1ba7-4724-84dc-03b3212ca698 admin admin] PATH_INFO: `/v3/projects/f6b60137da97423d9cd1fe0bd2581351/users/8f8337d311964f7bbdc78ed8ab405c4d/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.455101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976bdf9-1ba7-4724-84dc-03b3212ca698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b60137da97423d9cd1fe0bd2581351, user_id=8f8337d311964f7bbdc78ed8ab405c4d, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.457709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b976bdf9-1ba7-4724-84dc-03b3212ca698 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.494339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1010/2023] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:29 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:29.495875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48641348-f2be-480b-a0ba-0ac4adb02fe5 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.500226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48641348-f2be-480b-a0ba-0ac4adb02fe5 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.500226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48641348-f2be-480b-a0ba-0ac4adb02fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.513643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-48641348-f2be-480b-a0ba-0ac4adb02fe5 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:29.514901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-48641348-f2be-480b-a0ba-0ac4adb02fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:29.521602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1014/2024] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:29 2021] PUT /identity/v3/projects/f6b60137da97423d9cd1fe0bd2581351/users/8f8337d311964f7bbdc78ed8ab405c4d/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:29.522448 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976bdf9-1ba7-4724-84dc-03b3212ca698 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.524954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b976bdf9-1ba7-4724-84dc-03b3212ca698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:29.580770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1011/2025] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:29.581813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48641348-f2be-480b-a0ba-0ac4adb02fe5 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.592139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48641348-f2be-480b-a0ba-0ac4adb02fe5 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.597185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e05f83-dfe6-46f7-a35c-fb72b1454203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.598139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e05f83-dfe6-46f7-a35c-fb72b1454203 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.598419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e05f83-dfe6-46f7-a35c-fb72b1454203 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.598692 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e05f83-dfe6-46f7-a35c-fb72b1454203 admin admin] PATH_INFO: `/v3/projects/32623a2f72f14f469dbcc3d202f0453c/users/e325602fa35d4a5fbba0f82c88d12371/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.600658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e05f83-dfe6-46f7-a35c-fb72b1454203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32623a2f72f14f469dbcc3d202f0453c, user_id=e325602fa35d4a5fbba0f82c88d12371, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.601471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b976bdf9-1ba7-4724-84dc-03b3212ca698 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.603453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e05f83-dfe6-46f7-a35c-fb72b1454203 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.606743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a88b8-6620-4a24-a89c-f5b0e52f5d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.607476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a88b8-6620-4a24-a89c-f5b0e52f5d91 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.608707 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a88b8-6620-4a24-a89c-f5b0e52f5d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.609076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a88b8-6620-4a24-a89c-f5b0e52f5d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.609857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a88b8-6620-4a24-a89c-f5b0e52f5d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.612091 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a88b8-6620-4a24-a89c-f5b0e52f5d91 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.618638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1012/2026] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:29 2021] PUT /identity/v3/projects/32623a2f72f14f469dbcc3d202f0453c/users/e325602fa35d4a5fbba0f82c88d12371/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:29.619717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e05f83-dfe6-46f7-a35c-fb72b1454203 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.621461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f8e05f83-dfe6-46f7-a35c-fb72b1454203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:29.690087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e05f83-dfe6-46f7-a35c-fb72b1454203 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.694852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04d0e-bee5-4486-9a96-6ca8f2cc0848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.695527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04d0e-bee5-4486-9a96-6ca8f2cc0848 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.695809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04d0e-bee5-4486-9a96-6ca8f2cc0848 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.696198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04d0e-bee5-4486-9a96-6ca8f2cc0848 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.697037 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df04d0e-bee5-4486-9a96-6ca8f2cc0848 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.698967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df04d0e-bee5-4486-9a96-6ca8f2cc0848 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.705864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1015/2027] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:29 2021] POST /identity/v3/projects => generated 363 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:29.707206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a88b8-6620-4a24-a89c-f5b0e52f5d91 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.769430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a88b8-6620-4a24-a89c-f5b0e52f5d91 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.774762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b2208-affc-45d6-ba38-b3a9e7787e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.775839 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2208-affc-45d6-ba38-b3a9e7787e6a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.776301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2208-affc-45d6-ba38-b3a9e7787e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.776674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b2208-affc-45d6-ba38-b3a9e7787e6a admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.777678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b2208-affc-45d6-ba38-b3a9e7787e6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.780426 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b2208-affc-45d6-ba38-b3a9e7787e6a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.794284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1013/2028] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:29 2021] POST /identity/v3/projects => generated 381 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:29.795168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1016/2029] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:29 2021] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:29.796201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04d0e-bee5-4486-9a96-6ca8f2cc0848 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.796384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b2208-affc-45d6-ba38-b3a9e7787e6a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.798976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2df04d0e-bee5-4486-9a96-6ca8f2cc0848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:29.808682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b2208-affc-45d6-ba38-b3a9e7787e6a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.871774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04d0e-bee5-4486-9a96-6ca8f2cc0848 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.875349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c96324-9510-40fd-801c-2d424389860c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.876351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9045e-c344-49aa-9af5-dae5cbbf2d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.876715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c96324-9510-40fd-801c-2d424389860c admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.876997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9045e-c344-49aa-9af5-dae5cbbf2d75 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.877210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c96324-9510-40fd-801c-2d424389860c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.877316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9045e-c344-49aa-9af5-dae5cbbf2d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.877553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9045e-c344-49aa-9af5-dae5cbbf2d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.877717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c96324-9510-40fd-801c-2d424389860c admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.878664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c96324-9510-40fd-801c-2d424389860c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.880855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c96324-9510-40fd-801c-2d424389860c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.895547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9045e-c344-49aa-9af5-dae5cbbf2d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.897051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9045e-c344-49aa-9af5-dae5cbbf2d75 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.908043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1014/2030] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:29.909243 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9045e-c344-49aa-9af5-dae5cbbf2d75 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:29.919009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9045e-c344-49aa-9af5-dae5cbbf2d75 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:29.924616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af188f5b-8086-4dab-b45c-94176b55293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:29.925538 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af188f5b-8086-4dab-b45c-94176b55293f admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:29.925810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af188f5b-8086-4dab-b45c-94176b55293f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:29.926141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af188f5b-8086-4dab-b45c-94176b55293f admin admin] PATH_INFO: `/v3/projects/f6b60137da97423d9cd1fe0bd2581351/users/8f8337d311964f7bbdc78ed8ab405c4d/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:29.928179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af188f5b-8086-4dab-b45c-94176b55293f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6b60137da97423d9cd1fe0bd2581351, user_id=8f8337d311964f7bbdc78ed8ab405c4d, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:29.933606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af188f5b-8086-4dab-b45c-94176b55293f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:29.941601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1015/2031] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:29 2021] PUT /identity/v3/projects/f6b60137da97423d9cd1fe0bd2581351/users/8f8337d311964f7bbdc78ed8ab405c4d/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:29.942504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af188f5b-8086-4dab-b45c-94176b55293f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.015735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1017/2032] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:29 2021] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:30.017183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce757f4-ddf9-45c5-9994-195dd8f95d3f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.017465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce757f4-ddf9-45c5-9994-195dd8f95d3f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.017743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce757f4-ddf9-45c5-9994-195dd8f95d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.024596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af188f5b-8086-4dab-b45c-94176b55293f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.031456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784470a-7a2e-4260-8bd0-38b3558a02a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.035640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784470a-7a2e-4260-8bd0-38b3558a02a7 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.035640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784470a-7a2e-4260-8bd0-38b3558a02a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.035640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5784470a-7a2e-4260-8bd0-38b3558a02a7 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.035640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784470a-7a2e-4260-8bd0-38b3558a02a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.036286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5784470a-7a2e-4260-8bd0-38b3558a02a7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.047779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5ce757f4-ddf9-45c5-9994-195dd8f95d3f None None] MFA Rules not processed for user `8f8337d311964f7bbdc78ed8ab405c4d`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:30.049684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5ce757f4-ddf9-45c5-9994-195dd8f95d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:30.094678 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1016/2033] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:29 2021] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:30.095590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784470a-7a2e-4260-8bd0-38b3558a02a7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.105677 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5784470a-7a2e-4260-8bd0-38b3558a02a7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.110625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee14378-27c0-420b-8172-9079eb85f80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.111286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee14378-27c0-420b-8172-9079eb85f80e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.111567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee14378-27c0-420b-8172-9079eb85f80e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.111820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee14378-27c0-420b-8172-9079eb85f80e admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.112545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee14378-27c0-420b-8172-9079eb85f80e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.114511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee14378-27c0-420b-8172-9079eb85f80e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.118805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1018/2034] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:30 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:30.119941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce757f4-ddf9-45c5-9994-195dd8f95d3f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.128680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1017/2035] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:30.130791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce757f4-ddf9-45c5-9994-195dd8f95d3f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.130916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee14378-27c0-420b-8172-9079eb85f80e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.132773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-cee14378-27c0-420b-8172-9079eb85f80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:30.136022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d893fb-e272-4a62-b375-f467e486bc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.137087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d893fb-e272-4a62-b375-f467e486bc2c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.137087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d893fb-e272-4a62-b375-f467e486bc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.137326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d893fb-e272-4a62-b375-f467e486bc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.137926 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d893fb-e272-4a62-b375-f467e486bc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.139529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d893fb-e272-4a62-b375-f467e486bc2c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.149861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1019/2036] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:30.156737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d893fb-e272-4a62-b375-f467e486bc2c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.161566 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d893fb-e272-4a62-b375-f467e486bc2c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.169470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe5c55-a474-4f8b-b035-b7ae49f2a6fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.170601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe5c55-a474-4f8b-b035-b7ae49f2a6fa admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.171538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe5c55-a474-4f8b-b035-b7ae49f2a6fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.171835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe5c55-a474-4f8b-b035-b7ae49f2a6fa admin admin] PATH_INFO: `/v3/projects/7d28f3e1bc4c4706ad93c3ab58f2658b/users/ac684eab73794c838f4e00e567438d60/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.189574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe5c55-a474-4f8b-b035-b7ae49f2a6fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d28f3e1bc4c4706ad93c3ab58f2658b, user_id=ac684eab73794c838f4e00e567438d60, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.192717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe5c55-a474-4f8b-b035-b7ae49f2a6fa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.196233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee14378-27c0-420b-8172-9079eb85f80e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.200108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36d52a-ca82-41b9-973b-169a692817a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.200769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36d52a-ca82-41b9-973b-169a692817a1 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.201029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36d52a-ca82-41b9-973b-169a692817a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.201301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36d52a-ca82-41b9-973b-169a692817a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.214691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36d52a-ca82-41b9-973b-169a692817a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.214691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c36d52a-ca82-41b9-973b-169a692817a1 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.230465 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1018/2037] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:30.236315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36d52a-ca82-41b9-973b-169a692817a1 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.244743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36d52a-ca82-41b9-973b-169a692817a1 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.251677 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ea232-f537-4c54-b894-7f6e0b7f4873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.253048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea232-f537-4c54-b894-7f6e0b7f4873 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.253447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea232-f537-4c54-b894-7f6e0b7f4873 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.253720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ea232-f537-4c54-b894-7f6e0b7f4873 admin admin] PATH_INFO: `/v3/projects/c0628f8e2e294180b06a14e1b8d8fe70/users/b4adb5b26b6945a496188bbd2d06800f/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.277645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1020/2038] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:30 2021] PUT /identity/v3/projects/7d28f3e1bc4c4706ad93c3ab58f2658b/users/ac684eab73794c838f4e00e567438d60/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:30.287723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe5c55-a474-4f8b-b035-b7ae49f2a6fa admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.288388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ea232-f537-4c54-b894-7f6e0b7f4873 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0628f8e2e294180b06a14e1b8d8fe70, user_id=b4adb5b26b6945a496188bbd2d06800f, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.291555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ea232-f537-4c54-b894-7f6e0b7f4873 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.362219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe5c55-a474-4f8b-b035-b7ae49f2a6fa admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.369996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2688ab-5beb-4894-a8a2-c7a7295b69b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.370783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2688ab-5beb-4894-a8a2-c7a7295b69b9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.371365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2688ab-5beb-4894-a8a2-c7a7295b69b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.371911 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2688ab-5beb-4894-a8a2-c7a7295b69b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.373994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2688ab-5beb-4894-a8a2-c7a7295b69b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.376597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2688ab-5beb-4894-a8a2-c7a7295b69b9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.379259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1019/2039] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:30 2021] PUT /identity/v3/projects/c0628f8e2e294180b06a14e1b8d8fe70/users/b4adb5b26b6945a496188bbd2d06800f/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:30.382608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ea232-f537-4c54-b894-7f6e0b7f4873 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.392905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1021/2040] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:30.399278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2688ab-5beb-4894-a8a2-c7a7295b69b9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.409360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2688ab-5beb-4894-a8a2-c7a7295b69b9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.461140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ea232-f537-4c54-b894-7f6e0b7f4873 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.466697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7653c47-a71d-4aea-bd1a-b3af50d97b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.467442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653c47-a71d-4aea-bd1a-b3af50d97b1f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.467785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653c47-a71d-4aea-bd1a-b3af50d97b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.468532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7653c47-a71d-4aea-bd1a-b3af50d97b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.469281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7653c47-a71d-4aea-bd1a-b3af50d97b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.470177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93440f65-4c3f-4800-ab31-aed0ef6ea134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.470937 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7653c47-a71d-4aea-bd1a-b3af50d97b1f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.471442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93440f65-4c3f-4800-ab31-aed0ef6ea134 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.471794 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93440f65-4c3f-4800-ab31-aed0ef6ea134 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.472140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93440f65-4c3f-4800-ab31-aed0ef6ea134 admin admin] PATH_INFO: `/v3/projects/7d28f3e1bc4c4706ad93c3ab58f2658b/users/ac684eab73794c838f4e00e567438d60/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.474409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93440f65-4c3f-4800-ab31-aed0ef6ea134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d28f3e1bc4c4706ad93c3ab58f2658b, user_id=ac684eab73794c838f4e00e567438d60, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.477959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93440f65-4c3f-4800-ab31-aed0ef6ea134 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.484294 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1020/2041] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:30 2021] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:30.484593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7653c47-a71d-4aea-bd1a-b3af50d97b1f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.498967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1022/2042] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:30 2021] PUT /identity/v3/projects/7d28f3e1bc4c4706ad93c3ab58f2658b/users/ac684eab73794c838f4e00e567438d60/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:30.498967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93440f65-4c3f-4800-ab31-aed0ef6ea134 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.501442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-93440f65-4c3f-4800-ab31-aed0ef6ea134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:30.505019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7653c47-a71d-4aea-bd1a-b3af50d97b1f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.572770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93440f65-4c3f-4800-ab31-aed0ef6ea134 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.577205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.577645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:30.578320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.578596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.578695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.578860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] PATH_INFO: `/v3/users/0b4f4402f2cc410a9fcb771b4cd75420` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.579015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.579399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] PATH_INFO: `/v3/projects/b6ba2634d8794896bebc2b39ed15d443` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.580235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b4f4402f2cc410a9fcb771b4cd75420)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.580718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6ba2634d8794896bebc2b39ed15d443)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:30.582140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.586495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:30.770549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b4f4402f2cc410a9fcb771b4cd75420'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.773032 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6ba2634d8794896bebc2b39ed15d443', 'request_id': 'req-fcab1b3e-6220-49ee-a568-7133d09f0100'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.783658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6ba2634d8794896bebc2b39ed15d443', 'request_id': 'req-fcab1b3e-6220-49ee-a568-7133d09f0100'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.784627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b4f4402f2cc410a9fcb771b4cd75420'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.791254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6ba2634d8794896bebc2b39ed15d443', 'request_id': 'req-fcab1b3e-6220-49ee-a568-7133d09f0100'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.793106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b4f4402f2cc410a9fcb771b4cd75420'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.794567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b4f4402f2cc410a9fcb771b4cd75420'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.859155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] The token cache is being invalidate because project b6ba2634d8794896bebc2b39ed15d443 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:30.859544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.860217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.861835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1023/2043] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:30 2021] DELETE /identity/v3/projects/b6ba2634d8794896bebc2b39ed15d443 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:30.862637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:30.864000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:30.910086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e307e8b0-ac0c-4533-b835-7a1ddfb50e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b4f4402f2cc410a9fcb771b4cd75420'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:30.920834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1021/2044] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:30 2021] DELETE /identity/v3/users/0b4f4402f2cc410a9fcb771b4cd75420 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:30.920834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0fdb0-f4bc-445f-9a0b-672f4ae262ca None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:30.920834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0fdb0-f4bc-445f-9a0b-672f4ae262ca None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:30.920834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0fdb0-f4bc-445f-9a0b-672f4ae262ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:30.940464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcab1b3e-6220-49ee-a568-7133d09f0100 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:30.952051 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c3c0fdb0-f4bc-445f-9a0b-672f4ae262ca None None] MFA Rules not processed for user `ac684eab73794c838f4e00e567438d60`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:30.953428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c3c0fdb0-f4bc-445f-9a0b-672f4ae262ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.028044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc459668-8b61-4ec3-83ba-2a3e7fdb0fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.029200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc459668-8b61-4ec3-83ba-2a3e7fdb0fe6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.029339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc459668-8b61-4ec3-83ba-2a3e7fdb0fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.029503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc459668-8b61-4ec3-83ba-2a3e7fdb0fe6 admin admin] PATH_INFO: `/v3/projects/c0628f8e2e294180b06a14e1b8d8fe70/users/b4adb5b26b6945a496188bbd2d06800f/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.035589 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc459668-8b61-4ec3-83ba-2a3e7fdb0fe6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0628f8e2e294180b06a14e1b8d8fe70, user_id=b4adb5b26b6945a496188bbd2d06800f, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.038558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc459668-8b61-4ec3-83ba-2a3e7fdb0fe6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.051287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1022/2045] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:30 2021] POST /identity/v3/auth/tokens => generated 3450 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:31.051287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0fdb0-f4bc-445f-9a0b-672f4ae262ca None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.056288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c3c0fdb0-f4bc-445f-9a0b-672f4ae262ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.061854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1024/2046] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:30 2021] PUT /identity/v3/projects/c0628f8e2e294180b06a14e1b8d8fe70/users/b4adb5b26b6945a496188bbd2d06800f/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:31.063328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5caa8-c31e-4ff6-a8ed-bef12ad31c84 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.063680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5caa8-c31e-4ff6-a8ed-bef12ad31c84 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.064017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5caa8-c31e-4ff6-a8ed-bef12ad31c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.079972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0fdb0-f4bc-445f-9a0b-672f4ae262ca None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.082048 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4ba5caa8-c31e-4ff6-a8ed-bef12ad31c84 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:31.082902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4ba5caa8-c31e-4ff6-a8ed-bef12ad31c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.139309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.140185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.140457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.140720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] PATH_INFO: `/v3/users/8e543c9e7a994bfc9077f7a5226d0b29` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.142824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e543c9e7a994bfc9077f7a5226d0b29)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.143884 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.145829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1025/2047] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:31.146666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5caa8-c31e-4ff6-a8ed-bef12ad31c84 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.148171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4ba5caa8-c31e-4ff6-a8ed-bef12ad31c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.213261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5caa8-c31e-4ff6-a8ed-bef12ad31c84 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.216935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbec2ce-7cd6-4171-bf88-ede026e35397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.217572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbec2ce-7cd6-4171-bf88-ede026e35397 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.217847 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbec2ce-7cd6-4171-bf88-ede026e35397 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.218182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbec2ce-7cd6-4171-bf88-ede026e35397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.278354 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbec2ce-7cd6-4171-bf88-ede026e35397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.279812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbec2ce-7cd6-4171-bf88-ede026e35397 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.290253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1026/2048] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/auth/tokens => generated 3450 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:31.292064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef28d4-6448-4508-9f82-1b8294940438 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.292394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef28d4-6448-4508-9f82-1b8294940438 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.292668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef28d4-6448-4508-9f82-1b8294940438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.320979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-81ef28d4-6448-4508-9f82-1b8294940438 None None] MFA Rules not processed for user `b4adb5b26b6945a496188bbd2d06800f`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:31.322518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-81ef28d4-6448-4508-9f82-1b8294940438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.368230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e543c9e7a994bfc9077f7a5226d0b29'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.381079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e543c9e7a994bfc9077f7a5226d0b29'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.390141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e543c9e7a994bfc9077f7a5226d0b29'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.390970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e543c9e7a994bfc9077f7a5226d0b29'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.396405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1027/2049] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:31 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:31.397266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef28d4-6448-4508-9f82-1b8294940438 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.399118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-81ef28d4-6448-4508-9f82-1b8294940438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.455945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef28d4-6448-4508-9f82-1b8294940438 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.459496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e715b-0f4c-4b4f-b193-33faf1a2e795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.460132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e715b-0f4c-4b4f-b193-33faf1a2e795 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.460411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e715b-0f4c-4b4f-b193-33faf1a2e795 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.460683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e715b-0f4c-4b4f-b193-33faf1a2e795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.470578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e715b-0f4c-4b4f-b193-33faf1a2e795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.471984 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e715b-0f4c-4b4f-b193-33faf1a2e795 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.481842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1028/2050] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:31.483496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a25ca0-9d54-44fc-81ae-6b2bb572a611 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.483781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a25ca0-9d54-44fc-81ae-6b2bb572a611 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.484050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a25ca0-9d54-44fc-81ae-6b2bb572a611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.492954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e543c9e7a994bfc9077f7a5226d0b29'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.499695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1023/2051] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:31 2021] DELETE /identity/v3/users/8e543c9e7a994bfc9077f7a5226d0b29 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:31.500650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.511138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.511989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e2a25ca0-9d54-44fc-81ae-6b2bb572a611 None None] MFA Rules not processed for user `e325602fa35d4a5fbba0f82c88d12371`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:31.513138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e2a25ca0-9d54-44fc-81ae-6b2bb572a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.597556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1029/2052] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:31 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:31.597556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a25ca0-9d54-44fc-81ae-6b2bb572a611 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.600267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e2a25ca0-9d54-44fc-81ae-6b2bb572a611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.623098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cdd6b1-3cf6-477f-a0a3-d904ee4d9c54 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.627483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.628357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.628623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.628892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] PATH_INFO: `/v3/users/7c337cd5d6584422a8ac0ee3d3f9fd81` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.630135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c337cd5d6584422a8ac0ee3d3f9fd81)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.634799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.659137 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a25ca0-9d54-44fc-81ae-6b2bb572a611 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.663565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.663565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.663810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.663928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.666449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.727350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.728778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.737968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1030/2053] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/auth/tokens => generated 3383 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:31.738886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.740284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.752082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1af36b-471d-488e-95ad-890021384a6e service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.756697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.757604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.757604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.758149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.760256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.833160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.834628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.846045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1031/2054] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:31 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:31.864317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c337cd5d6584422a8ac0ee3d3f9fd81'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.880484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c337cd5d6584422a8ac0ee3d3f9fd81'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.888545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c337cd5d6584422a8ac0ee3d3f9fd81'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.889801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c337cd5d6584422a8ac0ee3d3f9fd81'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.949976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:31.953222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:31.967588 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ebb6b844-7c49-497a-9109-f5920beb4c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c337cd5d6584422a8ac0ee3d3f9fd81'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:31.968418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c21ae-ec06-41f9-b6d8-46297d2ab70f service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:31.974686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:31.975850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.976212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.976499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1024/2055] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:31 2021] DELETE /identity/v3/users/7c337cd5d6584422a8ac0ee3d3f9fd81 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:31.976675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] PATH_INFO: `/v3/projects/6448ca2c87974a60b23c8d8ab52f13d8` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:31.978898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6448ca2c87974a60b23c8d8ab52f13d8)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:31.980833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:31.982300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3635-a669-4c83-bc14-df58f59dc5b3 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:31.982605 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3635-a669-4c83-bc14-df58f59dc5b3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:31.983113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3635-a669-4c83-bc14-df58f59dc5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.001084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2a5f3635-a669-4c83-bc14-df58f59dc5b3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:32.004427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2a5f3635-a669-4c83-bc14-df58f59dc5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:32.072781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1025/2056] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:31 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:32.073626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f3635-a669-4c83-bc14-df58f59dc5b3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.075418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2a5f3635-a669-4c83-bc14-df58f59dc5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:32.094327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f3635-a669-4c83-bc14-df58f59dc5b3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.103577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6448ca2c87974a60b23c8d8ab52f13d8', 'request_id': 'req-4d47c978-bf41-42dd-80f4-d5894d570dfa'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.110214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6448ca2c87974a60b23c8d8ab52f13d8', 'request_id': 'req-4d47c978-bf41-42dd-80f4-d5894d570dfa'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.119252 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6448ca2c87974a60b23c8d8ab52f13d8', 'request_id': 'req-4d47c978-bf41-42dd-80f4-d5894d570dfa'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.171345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.171345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.171345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.171345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] PATH_INFO: `/v3/projects/af1736e3d31b4abbb30d82a0a7c0a4b2` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.171727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af1736e3d31b4abbb30d82a0a7c0a4b2)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.175482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.196889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] The token cache is being invalidate because project 6448ca2c87974a60b23c8d8ab52f13d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:32.203138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.203138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.203138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1032/2057] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:31 2021] DELETE /identity/v3/projects/6448ca2c87974a60b23c8d8ab52f13d8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:32.203138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.203138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:32.270459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d47c978-bf41-42dd-80f4-d5894d570dfa admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.274692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.275323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.275604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.275874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.277702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:32.290693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.292119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.301798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1033/2058] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:32 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:32.302702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.304143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:32.317578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dae247-b962-48c5-8209-fa7ce900bb93 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.329910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af1736e3d31b4abbb30d82a0a7c0a4b2', 'request_id': 'req-727fffa2-91d3-4224-9aab-5a830c5402c0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.338647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af1736e3d31b4abbb30d82a0a7c0a4b2', 'request_id': 'req-727fffa2-91d3-4224-9aab-5a830c5402c0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.345831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af1736e3d31b4abbb30d82a0a7c0a4b2', 'request_id': 'req-727fffa2-91d3-4224-9aab-5a830c5402c0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.384265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.385133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.385896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.386207 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] PATH_INFO: `/v3/users/8f8337d311964f7bbdc78ed8ab405c4d` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.387453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f8337d311964f7bbdc78ed8ab405c4d)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.389338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.435036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] The token cache is being invalidate because project af1736e3d31b4abbb30d82a0a7c0a4b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:32.435317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.435941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.437441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1026/2059] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:32 2021] DELETE /identity/v3/projects/af1736e3d31b4abbb30d82a0a7c0a4b2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:32.441372 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.442659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:32.455253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727fffa2-91d3-4224-9aab-5a830c5402c0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.459789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.460608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.463704 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.463704 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] PATH_INFO: `/v3/users/bafadaea769b4f92ba0268ac2c1bf64c` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.463704 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bafadaea769b4f92ba0268ac2c1bf64c)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.464901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:32.615870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f8337d311964f7bbdc78ed8ab405c4d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.629451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f8337d311964f7bbdc78ed8ab405c4d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.637833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f8337d311964f7bbdc78ed8ab405c4d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.674594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bafadaea769b4f92ba0268ac2c1bf64c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.687186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bafadaea769b4f92ba0268ac2c1bf64c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.693636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bafadaea769b4f92ba0268ac2c1bf64c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.694358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bafadaea769b4f92ba0268ac2c1bf64c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.739040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f8337d311964f7bbdc78ed8ab405c4d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.739417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f8337d311964f7bbdc78ed8ab405c4d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.747370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1034/2060] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:32 2021] DELETE /identity/v3/users/8f8337d311964f7bbdc78ed8ab405c4d => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:32.748220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:32.751229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:32.796339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bafadaea769b4f92ba0268ac2c1bf64c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:32.804681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1027/2061] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:32 2021] DELETE /identity/v3/users/bafadaea769b4f92ba0268ac2c1bf64c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:32.821476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e891c7-8f32-4b94-9572-f31d14e9979a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:32.884173 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:32.887451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:32.887451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:32.887451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] PATH_INFO: `/v3/projects/e2a61a6a983d40a892e86265ea53e264` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:32.887451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2a61a6a983d40a892e86265ea53e264)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:32.888748 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:33.079572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2a61a6a983d40a892e86265ea53e264', 'request_id': 'req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.087020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2a61a6a983d40a892e86265ea53e264', 'request_id': 'req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.093364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2a61a6a983d40a892e86265ea53e264', 'request_id': 'req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.178195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] The token cache is being invalidate because project e2a61a6a983d40a892e86265ea53e264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:33.178478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.179088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.181257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1035/2062] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:32 2021] DELETE /identity/v3/projects/e2a61a6a983d40a892e86265ea53e264 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:33.185220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.186659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:33.199751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c202a-76a4-4b79-b11a-f8097441bbb3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.211735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.214843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:33.298525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd60194-224c-482a-a3bc-bb8bcafa5d3c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.303853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.305503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.305865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.306390 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] PATH_INFO: `/v3/projects/f6b60137da97423d9cd1fe0bd2581351` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.307970 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6b60137da97423d9cd1fe0bd2581351)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:33.309940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:33.316335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.317344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.319046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.319046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] PATH_INFO: `/v3/users/b4adb5b26b6945a496188bbd2d06800f` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.320642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4adb5b26b6945a496188bbd2d06800f)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:33.323923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:33.586718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4adb5b26b6945a496188bbd2d06800f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.586992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6b60137da97423d9cd1fe0bd2581351', 'request_id': 'req-e3c53e18-26e4-4b90-8635-fc069f94fb90'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.592832 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6b60137da97423d9cd1fe0bd2581351', 'request_id': 'req-e3c53e18-26e4-4b90-8635-fc069f94fb90'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.598067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4adb5b26b6945a496188bbd2d06800f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.598401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6b60137da97423d9cd1fe0bd2581351', 'request_id': 'req-e3c53e18-26e4-4b90-8635-fc069f94fb90'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.605450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4adb5b26b6945a496188bbd2d06800f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.606162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4adb5b26b6945a496188bbd2d06800f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.698745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] The token cache is being invalidate because project f6b60137da97423d9cd1fe0bd2581351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:33.699030 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.712052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.712052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1036/2063] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:33 2021] DELETE /identity/v3/projects/f6b60137da97423d9cd1fe0bd2581351 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:33.712052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.712052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:33.755696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-983eac49-9217-4110-9137-d5d9edd00512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4adb5b26b6945a496188bbd2d06800f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:33.762776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1028/2064] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:33 2021] DELETE /identity/v3/users/b4adb5b26b6945a496188bbd2d06800f => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:33.767892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27cfb-799d-44c7-b19d-d05acd72a1a3 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.767892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27cfb-799d-44c7-b19d-d05acd72a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.767892 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27cfb-799d-44c7-b19d-d05acd72a1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.775575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c53e18-26e4-4b90-8635-fc069f94fb90 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.790766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-fea27cfb-799d-44c7-b19d-d05acd72a1a3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:33.792431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-fea27cfb-799d-44c7-b19d-d05acd72a1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:33.839757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.840888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.841294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.841672 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] PATH_INFO: `/v3/projects/64e7dcdb94fe420691f9e7712444515e` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.843082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64e7dcdb94fe420691f9e7712444515e)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:33.845088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:33.859681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1029/2065] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:33 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:33.860544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27cfb-799d-44c7-b19d-d05acd72a1a3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:33.866676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-fea27cfb-799d-44c7-b19d-d05acd72a1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:33.921738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27cfb-799d-44c7-b19d-d05acd72a1a3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:33.925479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b92c8-2e63-44df-bf65-bbbdf2b8f2f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:33.926251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b92c8-2e63-44df-bf65-bbbdf2b8f2f8 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:33.926521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b92c8-2e63-44df-bf65-bbbdf2b8f2f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:33.926791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b92c8-2e63-44df-bf65-bbbdf2b8f2f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:33.928593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1e5b92c8-2e63-44df-bf65-bbbdf2b8f2f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:33.999999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b92c8-2e63-44df-bf65-bbbdf2b8f2f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.001435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b92c8-2e63-44df-bf65-bbbdf2b8f2f8 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.014254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64e7dcdb94fe420691f9e7712444515e', 'request_id': 'req-0b528202-ff96-4061-bf64-af5c91a6fe66'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.021454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64e7dcdb94fe420691f9e7712444515e', 'request_id': 'req-0b528202-ff96-4061-bf64-af5c91a6fe66'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.028386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1030/2066] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:33 2021] GET /identity/v3/auth/tokens => generated 3460 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:34.034283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330042-cc4c-44db-ba79-bc7d51940a29 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.036327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330042-cc4c-44db-ba79-bc7d51940a29 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.036897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64e7dcdb94fe420691f9e7712444515e', 'request_id': 'req-0b528202-ff96-4061-bf64-af5c91a6fe66'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.037073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad330042-cc4c-44db-ba79-bc7d51940a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.064104 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ad330042-cc4c-44db-ba79-bc7d51940a29 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:34.065312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ad330042-cc4c-44db-ba79-bc7d51940a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.125923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] The token cache is being invalidate because project 64e7dcdb94fe420691f9e7712444515e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:34.126336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.127032 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.128560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1037/2067] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:33 2021] DELETE /identity/v3/projects/64e7dcdb94fe420691f9e7712444515e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:34.130128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1031/2068] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:34.134504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.139542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.153453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b528202-ff96-4061-bf64-af5c91a6fe66 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.159817 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.160587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.160866 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.161139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.161903 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:34.162234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.163864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.177444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1038/2069] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:34.182649 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330042-cc4c-44db-ba79-bc7d51940a29 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.194439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad330042-cc4c-44db-ba79-bc7d51940a29 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.206873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc902cb5-d2f7-4a64-9731-141ac6ed7a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.207592 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc902cb5-d2f7-4a64-9731-141ac6ed7a95 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.207874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc902cb5-d2f7-4a64-9731-141ac6ed7a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.208159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc902cb5-d2f7-4a64-9731-141ac6ed7a95 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.209149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc902cb5-d2f7-4a64-9731-141ac6ed7a95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.211931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc902cb5-d2f7-4a64-9731-141ac6ed7a95 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.241308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.241308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.252429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689f4506-9906-4041-8c83-86818866be26 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.259076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.260405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.260743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.264625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] PATH_INFO: `/v3/projects/c0628f8e2e294180b06a14e1b8d8fe70` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.264625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0628f8e2e294180b06a14e1b8d8fe70)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.264625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.349961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1032/2070] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:34.349961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc902cb5-d2f7-4a64-9731-141ac6ed7a95 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.394900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc902cb5-d2f7-4a64-9731-141ac6ed7a95 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.400124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec90072-08a8-4680-8b79-556922ae1693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.400784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec90072-08a8-4680-8b79-556922ae1693 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.401073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec90072-08a8-4680-8b79-556922ae1693 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.401329 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec90072-08a8-4680-8b79-556922ae1693 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.402012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec90072-08a8-4680-8b79-556922ae1693 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.403901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec90072-08a8-4680-8b79-556922ae1693 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.431245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0628f8e2e294180b06a14e1b8d8fe70', 'request_id': 'req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.438108 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0628f8e2e294180b06a14e1b8d8fe70', 'request_id': 'req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.444594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0628f8e2e294180b06a14e1b8d8fe70', 'request_id': 'req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.477942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1033/2071] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/users => generated 292 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:34.482946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec90072-08a8-4680-8b79-556922ae1693 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.499013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec90072-08a8-4680-8b79-556922ae1693 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.576700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143974e-c577-48cd-b48b-7400d79d9e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.577587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143974e-c577-48cd-b48b-7400d79d9e27 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.577865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143974e-c577-48cd-b48b-7400d79d9e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.578229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143974e-c577-48cd-b48b-7400d79d9e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.578980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143974e-c577-48cd-b48b-7400d79d9e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.580756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143974e-c577-48cd-b48b-7400d79d9e27 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.584245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] The token cache is being invalidate because project c0628f8e2e294180b06a14e1b8d8fe70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:34.584544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.588624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1c0f63d4-8763-4d85-b1bf-0fc1100c2a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:34.589262 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1039/2072] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:34 2021] DELETE /identity/v3/projects/c0628f8e2e294180b06a14e1b8d8fe70 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:34.595031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561776-16d9-4b4e-ad70-e875865e1fde None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.595395 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561776-16d9-4b4e-ad70-e875865e1fde None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.595662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71561776-16d9-4b4e-ad70-e875865e1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.598716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1034/2073] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:34.603916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143974e-c577-48cd-b48b-7400d79d9e27 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.615864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0143974e-c577-48cd-b48b-7400d79d9e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.623483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-71561776-16d9-4b4e-ad70-e875865e1fde None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:34.624702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-71561776-16d9-4b4e-ad70-e875865e1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.636676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1040/2074] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:34.638847 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143974e-c577-48cd-b48b-7400d79d9e27 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.648019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2d279-12fd-4425-a246-e9c583746295 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.648425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2d279-12fd-4425-a246-e9c583746295 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.648706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e2d279-12fd-4425-a246-e9c583746295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.653551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debce62c-0a4d-4f2d-b1ea-7c0fea8fd6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.654347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debce62c-0a4d-4f2d-b1ea-7c0fea8fd6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.654626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debce62c-0a4d-4f2d-b1ea-7c0fea8fd6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.654900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debce62c-0a4d-4f2d-b1ea-7c0fea8fd6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.655645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debce62c-0a4d-4f2d-b1ea-7c0fea8fd6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.657642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debce62c-0a4d-4f2d-b1ea-7c0fea8fd6a2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.668078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d6e2d279-12fd-4425-a246-e9c583746295 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:34.669257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d6e2d279-12fd-4425-a246-e9c583746295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.669665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1035/2075] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:34.673751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debce62c-0a4d-4f2d-b1ea-7c0fea8fd6a2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.677311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1041/2076] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:34.681450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2d279-12fd-4425-a246-e9c583746295 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.684186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debce62c-0a4d-4f2d-b1ea-7c0fea8fd6a2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.688936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488e8d8-49cc-4fbe-83c0-43dbcc54d6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.689795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488e8d8-49cc-4fbe-83c0-43dbcc54d6f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.690144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488e8d8-49cc-4fbe-83c0-43dbcc54d6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.690287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e2d279-12fd-4425-a246-e9c583746295 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.690422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488e8d8-49cc-4fbe-83c0-43dbcc54d6f3 admin admin] PATH_INFO: `/v3/projects/dc241b2321034bd6828e89bae595cdce/users/8e205ba311084726812055726b69fb49/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.696041 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09a796-4876-409b-9858-f3184d2b09f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.697709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09a796-4876-409b-9858-f3184d2b09f1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.697709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09a796-4876-409b-9858-f3184d2b09f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.697709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09a796-4876-409b-9858-f3184d2b09f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.697961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09a796-4876-409b-9858-f3184d2b09f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:34.698253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09a796-4876-409b-9858-f3184d2b09f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.699814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e09a796-4876-409b-9858-f3184d2b09f1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.705172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488e8d8-49cc-4fbe-83c0-43dbcc54d6f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc241b2321034bd6828e89bae595cdce, user_id=8e205ba311084726812055726b69fb49, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.707787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488e8d8-49cc-4fbe-83c0-43dbcc54d6f3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.712803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1042/2077] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:20:34.719229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09a796-4876-409b-9858-f3184d2b09f1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.728008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09a796-4876-409b-9858-f3184d2b09f1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.732978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a0fb-0017-4fac-9284-8105efc0d152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.733627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a0fb-0017-4fac-9284-8105efc0d152 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.733901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a0fb-0017-4fac-9284-8105efc0d152 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.734211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a0fb-0017-4fac-9284-8105efc0d152 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.734937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711a0fb-0017-4fac-9284-8105efc0d152 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.736797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711a0fb-0017-4fac-9284-8105efc0d152 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.767142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1036/2078] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:34 2021] PUT /identity/v3/projects/dc241b2321034bd6828e89bae595cdce/users/8e205ba311084726812055726b69fb49/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:34.779079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9a5e0-a491-4c38-96d6-e004288a6594 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.779363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9a5e0-a491-4c38-96d6-e004288a6594 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.779632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a9a5e0-a491-4c38-96d6-e004288a6594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.805486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-06a9a5e0-a491-4c38-96d6-e004288a6594 None None] MFA Rules not processed for user `8e205ba311084726812055726b69fb49`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:34.806805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-06a9a5e0-a491-4c38-96d6-e004288a6594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.829228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1043/2079] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/projects => generated 355 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:34.830291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a0fb-0017-4fac-9284-8105efc0d152 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.872178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1037/2080] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:34.882536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9a5e0-a491-4c38-96d6-e004288a6594 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:34.884752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-06a9a5e0-a491-4c38-96d6-e004288a6594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:34.892177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a0fb-0017-4fac-9284-8105efc0d152 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.897087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515c3a8-dc0a-40f1-8f77-63146893b698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.897786 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515c3a8-dc0a-40f1-8f77-63146893b698 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.898093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515c3a8-dc0a-40f1-8f77-63146893b698 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.898743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515c3a8-dc0a-40f1-8f77-63146893b698 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.899463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515c3a8-dc0a-40f1-8f77-63146893b698 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:34.901369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515c3a8-dc0a-40f1-8f77-63146893b698 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:34.939129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a9a5e0-a491-4c38-96d6-e004288a6594 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:34.988436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de9c4e-96e4-4d4a-aedf-f4811a7eb694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:34.989193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de9c4e-96e4-4d4a-aedf-f4811a7eb694 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:34.989570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de9c4e-96e4-4d4a-aedf-f4811a7eb694 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:34.989949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de9c4e-96e4-4d4a-aedf-f4811a7eb694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:34.990701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1044/2081] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:34 2021] POST /identity/v3/users => generated 278 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:34.994803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515c3a8-dc0a-40f1-8f77-63146893b698 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.004579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515c3a8-dc0a-40f1-8f77-63146893b698 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.009762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d29f6-0fa6-436b-a7e1-0e6f591c0481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.010453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d29f6-0fa6-436b-a7e1-0e6f591c0481 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.010737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d29f6-0fa6-436b-a7e1-0e6f591c0481 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.011010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d29f6-0fa6-436b-a7e1-0e6f591c0481 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.011903 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d29f6-0fa6-436b-a7e1-0e6f591c0481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.013487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d29f6-0fa6-436b-a7e1-0e6f591c0481 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.024468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1045/2082] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:35.028324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d29f6-0fa6-436b-a7e1-0e6f591c0481 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.038169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d29f6-0fa6-436b-a7e1-0e6f591c0481 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.045197 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5e272-05b8-41f0-b726-5db217375443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.045758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5e272-05b8-41f0-b726-5db217375443 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.045938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5e272-05b8-41f0-b726-5db217375443 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.046290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f5e272-05b8-41f0-b726-5db217375443 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.046974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5e272-05b8-41f0-b726-5db217375443 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.048555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f5e272-05b8-41f0-b726-5db217375443 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.051962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de9c4e-96e4-4d4a-aedf-f4811a7eb694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.053602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de9c4e-96e4-4d4a-aedf-f4811a7eb694 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.061953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1046/2083] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:35.063173 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5e272-05b8-41f0-b726-5db217375443 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.066513 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1038/2084] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:34 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:35.074089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f5e272-05b8-41f0-b726-5db217375443 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.080698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0adeb9-febf-4c17-8c3b-dbc8fb8da346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.082255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0adeb9-febf-4c17-8c3b-dbc8fb8da346 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.082812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0adeb9-febf-4c17-8c3b-dbc8fb8da346 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.082812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0adeb9-febf-4c17-8c3b-dbc8fb8da346 admin admin] PATH_INFO: `/v3/projects/c063600c38644af0b077c0890eec0367/users/cda58252dd0b42359625192ff79f776e/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.100527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0adeb9-febf-4c17-8c3b-dbc8fb8da346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c063600c38644af0b077c0890eec0367, user_id=cda58252dd0b42359625192ff79f776e, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.105048 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0adeb9-febf-4c17-8c3b-dbc8fb8da346 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.180120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1047/2085] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:35 2021] PUT /identity/v3/projects/c063600c38644af0b077c0890eec0367/users/cda58252dd0b42359625192ff79f776e/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:35.190514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065d3f9-b2d1-4ad0-ac53-b31ea070e322 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.190794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065d3f9-b2d1-4ad0-ac53-b31ea070e322 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.191064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d065d3f9-b2d1-4ad0-ac53-b31ea070e322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.217786 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d065d3f9-b2d1-4ad0-ac53-b31ea070e322 None None] MFA Rules not processed for user `cda58252dd0b42359625192ff79f776e`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:35.219055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d065d3f9-b2d1-4ad0-ac53-b31ea070e322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:35.282918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1039/2086] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:35 2021] POST /identity/v3/auth/tokens => generated 3375 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:35.287535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0adeb9-febf-4c17-8c3b-dbc8fb8da346 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.346182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0adeb9-febf-4c17-8c3b-dbc8fb8da346 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.350737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac898e9-ca9a-4058-b0db-8bd4e4914959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.351377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac898e9-ca9a-4058-b0db-8bd4e4914959 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.352232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac898e9-ca9a-4058-b0db-8bd4e4914959 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.352509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac898e9-ca9a-4058-b0db-8bd4e4914959 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.353204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac898e9-ca9a-4058-b0db-8bd4e4914959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.355116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac898e9-ca9a-4058-b0db-8bd4e4914959 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.464732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1048/2087] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:35 2021] POST /identity/v3/projects => generated 355 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:35.468782 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065d3f9-b2d1-4ad0-ac53-b31ea070e322 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.480150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d065d3f9-b2d1-4ad0-ac53-b31ea070e322 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.533845 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fee3f-bcb0-4602-8bec-a5d92f63ecee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.534533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fee3f-bcb0-4602-8bec-a5d92f63ecee admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.534810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fee3f-bcb0-4602-8bec-a5d92f63ecee admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.535078 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fee3f-bcb0-4602-8bec-a5d92f63ecee admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.535770 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fee3f-bcb0-4602-8bec-a5d92f63ecee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.537659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fee3f-bcb0-4602-8bec-a5d92f63ecee admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.637133 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1040/2088] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:35 2021] POST /identity/v3/users => generated 284 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:35.641045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac898e9-ca9a-4058-b0db-8bd4e4914959 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.651518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac898e9-ca9a-4058-b0db-8bd4e4914959 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.656096 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a9abf-87ed-4347-8ff3-e3c132193bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.656740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9abf-87ed-4347-8ff3-e3c132193bce admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.657017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9abf-87ed-4347-8ff3-e3c132193bce admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.657286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a9abf-87ed-4347-8ff3-e3c132193bce admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.658017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a9abf-87ed-4347-8ff3-e3c132193bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.666143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976a9abf-87ed-4347-8ff3-e3c132193bce admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.671783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1049/2089] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:35 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:35.675797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fee3f-bcb0-4602-8bec-a5d92f63ecee admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.689570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fee3f-bcb0-4602-8bec-a5d92f63ecee admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.694360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01070023-57d6-4f09-a7ef-f2bbcd8e22f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.695873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01070023-57d6-4f09-a7ef-f2bbcd8e22f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.696329 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01070023-57d6-4f09-a7ef-f2bbcd8e22f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.696599 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01070023-57d6-4f09-a7ef-f2bbcd8e22f7 admin admin] PATH_INFO: `/v3/projects/86acbcdbc133440c8fbefeec037ec811/users/4ea4c386a8ce4eb6bfee3a8f3f3c0c50/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.713658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01070023-57d6-4f09-a7ef-f2bbcd8e22f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86acbcdbc133440c8fbefeec037ec811, user_id=4ea4c386a8ce4eb6bfee3a8f3f3c0c50, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.718558 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01070023-57d6-4f09-a7ef-f2bbcd8e22f7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.797089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1041/2090] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:35 2021] PUT /identity/v3/projects/86acbcdbc133440c8fbefeec037ec811/users/4ea4c386a8ce4eb6bfee3a8f3f3c0c50/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:35.801405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a9abf-87ed-4347-8ff3-e3c132193bce admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.812430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a9abf-87ed-4347-8ff3-e3c132193bce admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.924138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99713cbc-5bcc-4970-a9ae-3db8c674321c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.924799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713cbc-5bcc-4970-a9ae-3db8c674321c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.925078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713cbc-5bcc-4970-a9ae-3db8c674321c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.925348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99713cbc-5bcc-4970-a9ae-3db8c674321c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.926109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99713cbc-5bcc-4970-a9ae-3db8c674321c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.927741 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99713cbc-5bcc-4970-a9ae-3db8c674321c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.938231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1050/2091] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:35 2021] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:35.942457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01070023-57d6-4f09-a7ef-f2bbcd8e22f7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:35.953344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01070023-57d6-4f09-a7ef-f2bbcd8e22f7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:35.958245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c6fea-38d8-4690-b477-afe07e61ff37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:35.959125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c6fea-38d8-4690-b477-afe07e61ff37 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.959389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c6fea-38d8-4690-b477-afe07e61ff37 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.959659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c6fea-38d8-4690-b477-afe07e61ff37 admin admin] PATH_INFO: `/v3/projects/86acbcdbc133440c8fbefeec037ec811/users/4ea4c386a8ce4eb6bfee3a8f3f3c0c50/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:35.963003 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c6fea-38d8-4690-b477-afe07e61ff37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86acbcdbc133440c8fbefeec037ec811, user_id=4ea4c386a8ce4eb6bfee3a8f3f3c0c50, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:35.965605 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c6fea-38d8-4690-b477-afe07e61ff37 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:35.976077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1042/2092] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:35 2021] PUT /identity/v3/projects/86acbcdbc133440c8fbefeec037ec811/users/4ea4c386a8ce4eb6bfee3a8f3f3c0c50/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:35.988026 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20200290-212b-438f-b589-87783983c614 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:35.988511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20200290-212b-438f-b589-87783983c614 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:35.994971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20200290-212b-438f-b589-87783983c614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.021475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-20200290-212b-438f-b589-87783983c614 None None] MFA Rules not processed for user `4ea4c386a8ce4eb6bfee3a8f3f3c0c50`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:36.023685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-20200290-212b-438f-b589-87783983c614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:36.090681 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1051/2093] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:35 2021] POST /identity/v3/auth/tokens => generated 3442 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:36.316188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c6fea-38d8-4690-b477-afe07e61ff37 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.318307 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a19c6fea-38d8-4690-b477-afe07e61ff37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:36.381880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c6fea-38d8-4690-b477-afe07e61ff37 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.386057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a827627-08db-4615-8552-df1ae8a8825f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.388992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a827627-08db-4615-8552-df1ae8a8825f service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.388992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a827627-08db-4615-8552-df1ae8a8825f service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.388992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a827627-08db-4615-8552-df1ae8a8825f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.397429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a827627-08db-4615-8552-df1ae8a8825f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.403649 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a827627-08db-4615-8552-df1ae8a8825f service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.413842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1043/2094] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/auth/tokens => generated 3442 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:36.711430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20200290-212b-438f-b589-87783983c614 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:36.722980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20200290-212b-438f-b589-87783983c614 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:36.727265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdda503-932b-41ca-8bdd-48a7fb5d51ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:36.728108 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdda503-932b-41ca-8bdd-48a7fb5d51ba service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:36.728480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdda503-932b-41ca-8bdd-48a7fb5d51ba service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:36.728846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdda503-932b-41ca-8bdd-48a7fb5d51ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:36.794088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdda503-932b-41ca-8bdd-48a7fb5d51ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:36.795574 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdda503-932b-41ca-8bdd-48a7fb5d51ba service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:36.806392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1052/2095] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:36 2021] GET /identity/v3/auth/tokens => generated 3375 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:40.688682 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a827627-08db-4615-8552-df1ae8a8825f service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:40.749150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a827627-08db-4615-8552-df1ae8a8825f service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:40.754653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:40.755769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:40.755769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:40.759352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] PATH_INFO: `/v3/users/8e205ba311084726812055726b69fb49` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:40.759352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e205ba311084726812055726b69fb49)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:40.759660 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:41.005460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e205ba311084726812055726b69fb49'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:41.018996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e205ba311084726812055726b69fb49'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:41.028263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e205ba311084726812055726b69fb49'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:41.029646 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e205ba311084726812055726b69fb49'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:41.121475 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e205ba311084726812055726b69fb49'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:41.135567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1044/2096] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:40 2021] DELETE /identity/v3/users/8e205ba311084726812055726b69fb49 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:41.138663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eaf66-e9d8-44bb-af5f-f3c1f8fd1381 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.139142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eaf66-e9d8-44bb-af5f-f3c1f8fd1381 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.139229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6eaf66-e9d8-44bb-af5f-f3c1f8fd1381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.157320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5e6eaf66-e9d8-44bb-af5f-f3c1f8fd1381 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:41.158808 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5e6eaf66-e9d8-44bb-af5f-f3c1f8fd1381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:41.219320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1053/2097] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:41.230260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:41.231708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:41.288258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffd2819-7004-4ddf-bcd6-732af495ff1e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:41.292510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dce3d7-7ddd-46b1-a1ce-08cd4b835377 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:41.293155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dce3d7-7ddd-46b1-a1ce-08cd4b835377 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.293450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dce3d7-7ddd-46b1-a1ce-08cd4b835377 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.295767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dce3d7-7ddd-46b1-a1ce-08cd4b835377 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.303196 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dce3d7-7ddd-46b1-a1ce-08cd4b835377 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:41.305171 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dce3d7-7ddd-46b1-a1ce-08cd4b835377 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:41.314532 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1045/2098] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:41 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:41.848658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6eaf66-e9d8-44bb-af5f-f3c1f8fd1381 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:41.850057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5e6eaf66-e9d8-44bb-af5f-f3c1f8fd1381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:41.863253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6eaf66-e9d8-44bb-af5f-f3c1f8fd1381 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:41.883513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:41.883513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:41.883513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:41.883513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] PATH_INFO: `/v3/projects/dc241b2321034bd6828e89bae595cdce` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:41.884287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc241b2321034bd6828e89bae595cdce)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:41.885591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:42.040541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc241b2321034bd6828e89bae595cdce', 'request_id': 'req-874f7d4b-add5-4370-80db-c43f9bb1fb57'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:42.046960 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc241b2321034bd6828e89bae595cdce', 'request_id': 'req-874f7d4b-add5-4370-80db-c43f9bb1fb57'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:42.052361 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc241b2321034bd6828e89bae595cdce', 'request_id': 'req-874f7d4b-add5-4370-80db-c43f9bb1fb57'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:42.172596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] The token cache is being invalidate because project dc241b2321034bd6828e89bae595cdce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:42.173186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:42.173583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-874f7d4b-add5-4370-80db-c43f9bb1fb57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:42.175229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1054/2099] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:41 2021] DELETE /identity/v3/projects/dc241b2321034bd6828e89bae595cdce => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:42.180889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9c3f9-1c0c-4b48-95fe-17ea6e96a75d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:42.181301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9c3f9-1c0c-4b48-95fe-17ea6e96a75d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:42.181428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea9c3f9-1c0c-4b48-95fe-17ea6e96a75d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:42.199756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-cea9c3f9-1c0c-4b48-95fe-17ea6e96a75d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:42.200965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-cea9c3f9-1c0c-4b48-95fe-17ea6e96a75d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:42.259369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1046/2100] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:42.267224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80fca1-df2f-48c0-8340-82e282d84981 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:42.267514 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80fca1-df2f-48c0-8340-82e282d84981 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:42.267791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80fca1-df2f-48c0-8340-82e282d84981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:42.286874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9d80fca1-df2f-48c0-8340-82e282d84981 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:42.288079 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9d80fca1-df2f-48c0-8340-82e282d84981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:42.296099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1055/2101] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:42.300404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9c3f9-1c0c-4b48-95fe-17ea6e96a75d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:42.310394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea9c3f9-1c0c-4b48-95fe-17ea6e96a75d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:42.315003 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a08f51-761d-4c13-b989-b91f999219ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:42.319887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a08f51-761d-4c13-b989-b91f999219ed admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:42.319887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a08f51-761d-4c13-b989-b91f999219ed admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:42.319887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a08f51-761d-4c13-b989-b91f999219ed admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:42.319887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a08f51-761d-4c13-b989-b91f999219ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:42.319887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a08f51-761d-4c13-b989-b91f999219ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:42.319887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a08f51-761d-4c13-b989-b91f999219ed admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:42.330573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1047/2102] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:42 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:42.334815 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80fca1-df2f-48c0-8340-82e282d84981 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:42.344798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80fca1-df2f-48c0-8340-82e282d84981 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:42.349549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebc17f-1f3a-4429-9f3f-afd8063b7829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:42.350232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebc17f-1f3a-4429-9f3f-afd8063b7829 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:42.350552 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebc17f-1f3a-4429-9f3f-afd8063b7829 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:42.350810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edebc17f-1f3a-4429-9f3f-afd8063b7829 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:42.351712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebc17f-1f3a-4429-9f3f-afd8063b7829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:42.353659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edebc17f-1f3a-4429-9f3f-afd8063b7829 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:42.454560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1056/2103] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:42 2021] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:42.458772 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a08f51-761d-4c13-b989-b91f999219ed admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:42.469378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a08f51-761d-4c13-b989-b91f999219ed admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:42.524895 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d452a3-de77-49d0-a1f5-061280a5bf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:42.525561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d452a3-de77-49d0-a1f5-061280a5bf7e admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:42.525842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d452a3-de77-49d0-a1f5-061280a5bf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:42.526146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d452a3-de77-49d0-a1f5-061280a5bf7e admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:42.526895 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d452a3-de77-49d0-a1f5-061280a5bf7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:42.528837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d452a3-de77-49d0-a1f5-061280a5bf7e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:42.612096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1048/2104] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:42 2021] POST /identity/v3/users => generated 285 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:42.612220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebc17f-1f3a-4429-9f3f-afd8063b7829 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:42.623287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edebc17f-1f3a-4429-9f3f-afd8063b7829 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:42.627812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df424c5c-c992-4243-8079-359fbc89585d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:42.628582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df424c5c-c992-4243-8079-359fbc89585d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:42.629077 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df424c5c-c992-4243-8079-359fbc89585d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:42.629505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df424c5c-c992-4243-8079-359fbc89585d admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:42.630547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df424c5c-c992-4243-8079-359fbc89585d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:42.633439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df424c5c-c992-4243-8079-359fbc89585d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:42.644600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1057/2105] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:42 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:42.648838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d452a3-de77-49d0-a1f5-061280a5bf7e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:42.661079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d452a3-de77-49d0-a1f5-061280a5bf7e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:42.666203 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb685f90-e5e4-4e07-bbb0-0be24b5e144a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:42.666866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb685f90-e5e4-4e07-bbb0-0be24b5e144a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:42.667143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb685f90-e5e4-4e07-bbb0-0be24b5e144a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:42.667415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb685f90-e5e4-4e07-bbb0-0be24b5e144a admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:42.668150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb685f90-e5e4-4e07-bbb0-0be24b5e144a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:42.669869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb685f90-e5e4-4e07-bbb0-0be24b5e144a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:42.688572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1049/2106] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:42 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:42.689899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df424c5c-c992-4243-8079-359fbc89585d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:42.702326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df424c5c-c992-4243-8079-359fbc89585d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:42.706990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d5bb6-fdcd-4797-903b-f96dc83290d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:42.708010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5bb6-fdcd-4797-903b-f96dc83290d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:42.708323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5bb6-fdcd-4797-903b-f96dc83290d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:42.708665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d5bb6-fdcd-4797-903b-f96dc83290d0 admin admin] PATH_INFO: `/v3/projects/172b224b354742198a61aaedddefd8ba/users/aca8e666238c4fc589a03fdc58fa6f6a/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:42.724485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5bb6-fdcd-4797-903b-f96dc83290d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=172b224b354742198a61aaedddefd8ba, user_id=aca8e666238c4fc589a03fdc58fa6f6a, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:42.730171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d5bb6-fdcd-4797-903b-f96dc83290d0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:42.847918 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1058/2107] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:42 2021] PUT /identity/v3/projects/172b224b354742198a61aaedddefd8ba/users/aca8e666238c4fc589a03fdc58fa6f6a/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:42.858975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d8c4-04fd-40ee-a760-76f20d16550c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:42.859260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d8c4-04fd-40ee-a760-76f20d16550c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:42.859562 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b76d8c4-04fd-40ee-a760-76f20d16550c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:42.885672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0b76d8c4-04fd-40ee-a760-76f20d16550c None None] MFA Rules not processed for user `aca8e666238c4fc589a03fdc58fa6f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:42.886907 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0b76d8c4-04fd-40ee-a760-76f20d16550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:42.954167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1050/2108] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:42 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:42.964301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d5bb6-fdcd-4797-903b-f96dc83290d0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:42.966510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-6a2d5bb6-fdcd-4797-903b-f96dc83290d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:43.034531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d5bb6-fdcd-4797-903b-f96dc83290d0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:43.038342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049c8376-5341-4777-9b5f-414f433c0866 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f402e17093e4e99afda5ea019f335eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:43.039747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c8376-5341-4777-9b5f-414f433c0866 service glance] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:43.040040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c8376-5341-4777-9b5f-414f433c0866 service glance] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:43.040308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049c8376-5341-4777-9b5f-414f433c0866 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:43.049171 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c8376-5341-4777-9b5f-414f433c0866 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:43.050634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049c8376-5341-4777-9b5f-414f433c0866 service glance] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:43.060437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1059/2109] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:42 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:46.768371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76d8c4-04fd-40ee-a760-76f20d16550c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:46.770010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0b76d8c4-04fd-40ee-a760-76f20d16550c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:46.836639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b76d8c4-04fd-40ee-a760-76f20d16550c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:46.841802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:46.842935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:46.843213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:46.843483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] PATH_INFO: `/v3/users/8107a80a978048f696d39ca0af37876f` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:46.845158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8107a80a978048f696d39ca0af37876f)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:46.846736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.060669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8107a80a978048f696d39ca0af37876f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:47.072600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8107a80a978048f696d39ca0af37876f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:47.079605 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8107a80a978048f696d39ca0af37876f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:47.080317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8107a80a978048f696d39ca0af37876f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:47.161490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8107a80a978048f696d39ca0af37876f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:47.172091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1051/2110] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:46 2021] DELETE /identity/v3/users/8107a80a978048f696d39ca0af37876f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:47.175810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18716c-d4c1-42d7-8020-2c517edb0c15 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.176341 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18716c-d4c1-42d7-8020-2c517edb0c15 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.176341 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18716c-d4c1-42d7-8020-2c517edb0c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.193756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4b18716c-d4c1-42d7-8020-2c517edb0c15 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:47.195179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4b18716c-d4c1-42d7-8020-2c517edb0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:47.255283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1060/2111] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:47.266827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.268258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:47.322575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b91fa-e36f-4ea6-bfe0-5aacf3eef4cb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.326397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebe919-5d21-4974-93cd-3bcd87c625c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.327071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebe919-5d21-4974-93cd-3bcd87c625c0 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.327346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebe919-5d21-4974-93cd-3bcd87c625c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.327613 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebe919-5d21-4974-93cd-3bcd87c625c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.340577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebe919-5d21-4974-93cd-3bcd87c625c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.342039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ebe919-5d21-4974-93cd-3bcd87c625c0 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.352696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1052/2112] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:47.780717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18716c-d4c1-42d7-8020-2c517edb0c15 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:47.782174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4b18716c-d4c1-42d7-8020-2c517edb0c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:47.796216 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18716c-d4c1-42d7-8020-2c517edb0c15 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:47.801595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:47.802518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:47.802796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:47.803078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] PATH_INFO: `/v3/projects/ca27529e459e44b3b5cea41dc7ac819d` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:47.805307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca27529e459e44b3b5cea41dc7ac819d)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:47.810891 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:47.933119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca27529e459e44b3b5cea41dc7ac819d', 'request_id': 'req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:47.939169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca27529e459e44b3b5cea41dc7ac819d', 'request_id': 'req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:47.944456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca27529e459e44b3b5cea41dc7ac819d', 'request_id': 'req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:48.103719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] The token cache is being invalidate because project ca27529e459e44b3b5cea41dc7ac819d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:48.104008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:48.104649 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:48.106262 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1061/2113] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:47 2021] DELETE /identity/v3/projects/ca27529e459e44b3b5cea41dc7ac819d => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:48.110594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebe919-5d21-4974-93cd-3bcd87c625c0 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:48.120224 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebe919-5d21-4974-93cd-3bcd87c625c0 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:48.180202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:48.181069 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:48.181344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:48.181614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] PATH_INFO: `/v3/users/ac684eab73794c838f4e00e567438d60` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:48.182867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac684eab73794c838f4e00e567438d60)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:48.184797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:48.505590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac684eab73794c838f4e00e567438d60'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:48.517466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac684eab73794c838f4e00e567438d60'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:48.524213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac684eab73794c838f4e00e567438d60'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:48.528347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac684eab73794c838f4e00e567438d60'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:48.670365 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-db54ece1-bc97-4f21-9d48-2144014de678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac684eab73794c838f4e00e567438d60'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:48.676605 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1053/2114] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:48 2021] DELETE /identity/v3/users/ac684eab73794c838f4e00e567438d60 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:49.105993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.109234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:49.121890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbeb33-4aae-48d0-a9eb-62222b8f36c0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.181257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.193831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.193831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.193831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] PATH_INFO: `/v3/projects/7d28f3e1bc4c4706ad93c3ab58f2658b` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.193831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d28f3e1bc4c4706ad93c3ab58f2658b)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.193831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.295342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d28f3e1bc4c4706ad93c3ab58f2658b', 'request_id': 'req-b1803624-defc-488d-8f3d-07182d26765f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:49.301710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d28f3e1bc4c4706ad93c3ab58f2658b', 'request_id': 'req-b1803624-defc-488d-8f3d-07182d26765f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:49.308212 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d28f3e1bc4c4706ad93c3ab58f2658b', 'request_id': 'req-b1803624-defc-488d-8f3d-07182d26765f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:49.475434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] The token cache is being invalidate because project 7d28f3e1bc4c4706ad93c3ab58f2658b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:49.475719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:49.476972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1803624-defc-488d-8f3d-07182d26765f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:49.478769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1062/2115] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:49 2021] DELETE /identity/v3/projects/7d28f3e1bc4c4706ad93c3ab58f2658b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:49.493479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510347-0c29-45bb-b79f-69fe7900f84d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.494044 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510347-0c29-45bb-b79f-69fe7900f84d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.494044 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c510347-0c29-45bb-b79f-69fe7900f84d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.511564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1c510347-0c29-45bb-b79f-69fe7900f84d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:49.512743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1c510347-0c29-45bb-b79f-69fe7900f84d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:49.577250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1054/2116] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:49.586191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b74be7-d923-488a-9869-5c1faf8f2052 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.586870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b74be7-d923-488a-9869-5c1faf8f2052 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.587154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b74be7-d923-488a-9869-5c1faf8f2052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.606012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f1b74be7-d923-488a-9869-5c1faf8f2052 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:49.607209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f1b74be7-d923-488a-9869-5c1faf8f2052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:49.615291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1063/2117] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:49.620314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510347-0c29-45bb-b79f-69fe7900f84d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.629851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c510347-0c29-45bb-b79f-69fe7900f84d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.635034 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b9ef4-e813-40af-b8ce-c38457c1e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.635691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b9ef4-e813-40af-b8ce-c38457c1e7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.635985 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b9ef4-e813-40af-b8ce-c38457c1e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.636253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7b9ef4-e813-40af-b8ce-c38457c1e7b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.637010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b9ef4-e813-40af-b8ce-c38457c1e7b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:49.637309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b9ef4-e813-40af-b8ce-c38457c1e7b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.638958 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7b9ef4-e813-40af-b8ce-c38457c1e7b4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.651401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1055/2118] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:49 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:49.655862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b74be7-d923-488a-9869-5c1faf8f2052 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.668558 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b74be7-d923-488a-9869-5c1faf8f2052 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.675630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a8447-7c11-4d22-8efc-3b90164a2a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.676693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a8447-7c11-4d22-8efc-3b90164a2a32 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.676903 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a8447-7c11-4d22-8efc-3b90164a2a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.677090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a8447-7c11-4d22-8efc-3b90164a2a32 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.677805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a8447-7c11-4d22-8efc-3b90164a2a32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.680414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a8447-7c11-4d22-8efc-3b90164a2a32 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:49.832045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1064/2119] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:49 2021] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:49.836444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b9ef4-e813-40af-b8ce-c38457c1e7b4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:49.846889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7b9ef4-e813-40af-b8ce-c38457c1e7b4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:49.903943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb19759-58aa-4b66-8f26-fe620433d11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:49.904609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb19759-58aa-4b66-8f26-fe620433d11c admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:49.904888 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb19759-58aa-4b66-8f26-fe620433d11c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:49.905159 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb19759-58aa-4b66-8f26-fe620433d11c admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:49.905928 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb19759-58aa-4b66-8f26-fe620433d11c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:49.907840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb19759-58aa-4b66-8f26-fe620433d11c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:50.031141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1056/2120] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:49 2021] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:50.035324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a8447-7c11-4d22-8efc-3b90164a2a32 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:50.047413 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a8447-7c11-4d22-8efc-3b90164a2a32 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:50.052654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd59775-5464-4dc0-ae0d-452320ef5a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:50.053389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd59775-5464-4dc0-ae0d-452320ef5a2a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.053795 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd59775-5464-4dc0-ae0d-452320ef5a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.054576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd59775-5464-4dc0-ae0d-452320ef5a2a admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.055014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd59775-5464-4dc0-ae0d-452320ef5a2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:50.056670 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd59775-5464-4dc0-ae0d-452320ef5a2a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:50.069257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1065/2121] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:50 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:50.073401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb19759-58aa-4b66-8f26-fe620433d11c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:50.086226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb19759-58aa-4b66-8f26-fe620433d11c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:50.091840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dae0f3-f408-42b8-b2dc-d04217afd1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:50.092514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae0f3-f408-42b8-b2dc-d04217afd1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.092793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae0f3-f408-42b8-b2dc-d04217afd1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.093068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dae0f3-f408-42b8-b2dc-d04217afd1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.093802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dae0f3-f408-42b8-b2dc-d04217afd1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:50.095508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dae0f3-f408-42b8-b2dc-d04217afd1e6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:50.114011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1057/2122] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:50 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:50.115515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd59775-5464-4dc0-ae0d-452320ef5a2a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:50.125856 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd59775-5464-4dc0-ae0d-452320ef5a2a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:50.130779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97d5a8-16a2-4ca4-bd13-4427c2e4e9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:50.131905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97d5a8-16a2-4ca4-bd13-4427c2e4e9b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.132362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97d5a8-16a2-4ca4-bd13-4427c2e4e9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.132647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da97d5a8-16a2-4ca4-bd13-4427c2e4e9b5 admin admin] PATH_INFO: `/v3/projects/cc710e4a7fee41ea864d1729f98b7ee5/users/267dbb1d93e645e48430085f4e9bd8fa/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.148450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97d5a8-16a2-4ca4-bd13-4427c2e4e9b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc710e4a7fee41ea864d1729f98b7ee5, user_id=267dbb1d93e645e48430085f4e9bd8fa, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:50.151324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da97d5a8-16a2-4ca4-bd13-4427c2e4e9b5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:50.236546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1066/2123] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:50 2021] PUT /identity/v3/projects/cc710e4a7fee41ea864d1729f98b7ee5/users/267dbb1d93e645e48430085f4e9bd8fa/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:50.247038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f348a3-f096-4904-941b-75ac1b0df7fa None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.247351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f348a3-f096-4904-941b-75ac1b0df7fa None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.247623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f348a3-f096-4904-941b-75ac1b0df7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.276281 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d1f348a3-f096-4904-941b-75ac1b0df7fa None None] MFA Rules not processed for user `267dbb1d93e645e48430085f4e9bd8fa`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:50.277507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d1f348a3-f096-4904-941b-75ac1b0df7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:50.339300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1058/2124] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:50 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:50.343953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97d5a8-16a2-4ca4-bd13-4427c2e4e9b5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:50.403925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da97d5a8-16a2-4ca4-bd13-4427c2e4e9b5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:50.408650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245f63e-c4f9-48cc-9eaa-964a6c44b367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:50.409312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245f63e-c4f9-48cc-9eaa-964a6c44b367 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.409590 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245f63e-c4f9-48cc-9eaa-964a6c44b367 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.409858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245f63e-c4f9-48cc-9eaa-964a6c44b367 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.410655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245f63e-c4f9-48cc-9eaa-964a6c44b367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:50.414000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245f63e-c4f9-48cc-9eaa-964a6c44b367 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:50.557132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1067/2125] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:50 2021] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:50.561343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f348a3-f096-4904-941b-75ac1b0df7fa None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:50.572651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f348a3-f096-4904-941b-75ac1b0df7fa None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:50.634348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b870088-311d-4d8b-a9f4-7780347bde85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:50.640059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b870088-311d-4d8b-a9f4-7780347bde85 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.640059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b870088-311d-4d8b-a9f4-7780347bde85 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.640059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b870088-311d-4d8b-a9f4-7780347bde85 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.640059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b870088-311d-4d8b-a9f4-7780347bde85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:50.640059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b870088-311d-4d8b-a9f4-7780347bde85 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:50.750230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1059/2126] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:50 2021] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:50.754136 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245f63e-c4f9-48cc-9eaa-964a6c44b367 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:50.764668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245f63e-c4f9-48cc-9eaa-964a6c44b367 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:50.769155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9a96b-dbd5-4db6-a54a-a55ddab86ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:50.769823 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9a96b-dbd5-4db6-a54a-a55ddab86ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.770122 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9a96b-dbd5-4db6-a54a-a55ddab86ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.771668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac9a96b-dbd5-4db6-a54a-a55ddab86ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.771668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9a96b-dbd5-4db6-a54a-a55ddab86ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:50.772646 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac9a96b-dbd5-4db6-a54a-a55ddab86ee8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:50.782801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1068/2127] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:50 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:50.786824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b870088-311d-4d8b-a9f4-7780347bde85 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:50.796702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b870088-311d-4d8b-a9f4-7780347bde85 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:50.802174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c8a7-aa84-4af4-aaf9-a742f9fe2970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:50.806449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c8a7-aa84-4af4-aaf9-a742f9fe2970 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:50.806449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c8a7-aa84-4af4-aaf9-a742f9fe2970 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:50.806449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc5c8a7-aa84-4af4-aaf9-a742f9fe2970 admin admin] PATH_INFO: `/v3/projects/1bd51972c35042d3ba1efbd41ef04b5e/users/1f1bd1bb3fe84bc88ad0c5644e87edd4/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:50.819095 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5c8a7-aa84-4af4-aaf9-a742f9fe2970 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd51972c35042d3ba1efbd41ef04b5e, user_id=1f1bd1bb3fe84bc88ad0c5644e87edd4, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:50.822311 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc5c8a7-aa84-4af4-aaf9-a742f9fe2970 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:50.945603 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1060/2128] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:50 2021] PUT /identity/v3/projects/1bd51972c35042d3ba1efbd41ef04b5e/users/1f1bd1bb3fe84bc88ad0c5644e87edd4/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:50.949613 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9a96b-dbd5-4db6-a54a-a55ddab86ee8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:50.959577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac9a96b-dbd5-4db6-a54a-a55ddab86ee8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.016651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee6bc5d-2834-406f-98c0-36230c3fa5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.017364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6bc5d-2834-406f-98c0-36230c3fa5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.017643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6bc5d-2834-406f-98c0-36230c3fa5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.017918 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee6bc5d-2834-406f-98c0-36230c3fa5d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.018684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6bc5d-2834-406f-98c0-36230c3fa5d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.020265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee6bc5d-2834-406f-98c0-36230c3fa5d8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.030044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1069/2129] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:50 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:51.034263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c8a7-aa84-4af4-aaf9-a742f9fe2970 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.044806 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc5c8a7-aa84-4af4-aaf9-a742f9fe2970 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.049557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2739a8f-bb51-471a-aa52-6d5ea3464886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.050460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2739a8f-bb51-471a-aa52-6d5ea3464886 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.050860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2739a8f-bb51-471a-aa52-6d5ea3464886 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.051145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2739a8f-bb51-471a-aa52-6d5ea3464886 admin admin] PATH_INFO: `/v3/projects/1bd51972c35042d3ba1efbd41ef04b5e/users/1f1bd1bb3fe84bc88ad0c5644e87edd4/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.053687 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2739a8f-bb51-471a-aa52-6d5ea3464886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bd51972c35042d3ba1efbd41ef04b5e, user_id=1f1bd1bb3fe84bc88ad0c5644e87edd4, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.058142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2739a8f-bb51-471a-aa52-6d5ea3464886 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.070568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1061/2130] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:51 2021] PUT /identity/v3/projects/1bd51972c35042d3ba1efbd41ef04b5e/users/1f1bd1bb3fe84bc88ad0c5644e87edd4/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:51.080573 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f593-c9aa-4541-b0f4-f1a420a60786 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.081444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f593-c9aa-4541-b0f4-f1a420a60786 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.081444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9f593-c9aa-4541-b0f4-f1a420a60786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.108384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-fcd9f593-c9aa-4541-b0f4-f1a420a60786 None None] MFA Rules not processed for user `1f1bd1bb3fe84bc88ad0c5644e87edd4`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:51.109584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fcd9f593-c9aa-4541-b0f4-f1a420a60786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:51.177691 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1070/2131] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:51 2021] POST /identity/v3/auth/tokens => generated 3460 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:51.188203 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2739a8f-bb51-471a-aa52-6d5ea3464886 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:51.197975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e2739a8f-bb51-471a-aa52-6d5ea3464886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:51.249348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2739a8f-bb51-471a-aa52-6d5ea3464886 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:51.253048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd673c45-adca-4adf-a308-dcb1531deb4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:51.253676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd673c45-adca-4adf-a308-dcb1531deb4b service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:51.253954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd673c45-adca-4adf-a308-dcb1531deb4b service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:51.254259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd673c45-adca-4adf-a308-dcb1531deb4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:51.311971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd673c45-adca-4adf-a308-dcb1531deb4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:51.313523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd673c45-adca-4adf-a308-dcb1531deb4b service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:51.323162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1062/2132] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:51 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:54.670881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9f593-c9aa-4541-b0f4-f1a420a60786 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:54.730795 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9f593-c9aa-4541-b0f4-f1a420a60786 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:54.744301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:54.745206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:54.745492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:54.745771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] PATH_INFO: `/v3/users/267dbb1d93e645e48430085f4e9bd8fa` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:54.747128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267dbb1d93e645e48430085f4e9bd8fa)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:54.749149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.032161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267dbb1d93e645e48430085f4e9bd8fa'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.043479 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267dbb1d93e645e48430085f4e9bd8fa'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.050370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267dbb1d93e645e48430085f4e9bd8fa'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.120590 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267dbb1d93e645e48430085f4e9bd8fa'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.121333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267dbb1d93e645e48430085f4e9bd8fa'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.131045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1071/2133] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:54 2021] DELETE /identity/v3/users/267dbb1d93e645e48430085f4e9bd8fa => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:55.133377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11ac12-e8ce-4424-b395-8bf8fcee4971 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.133868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11ac12-e8ce-4424-b395-8bf8fcee4971 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.134483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc11ac12-e8ce-4424-b395-8bf8fcee4971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.153992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-dc11ac12-e8ce-4424-b395-8bf8fcee4971 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:55.155273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dc11ac12-e8ce-4424-b395-8bf8fcee4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:55.230120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1063/2134] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:55.239706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.241244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:55.313519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d8fd0-1cdb-4b8a-bee3-ffea06b0cc60 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.330089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb1d1-d859-475d-9020-ed914d48f67e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.330886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb1d1-d859-475d-9020-ed914d48f67e service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.331233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb1d1-d859-475d-9020-ed914d48f67e service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.331690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051bb1d1-d859-475d-9020-ed914d48f67e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.350523 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bb1d1-d859-475d-9020-ed914d48f67e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.352090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051bb1d1-d859-475d-9020-ed914d48f67e service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.370239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1072/2135] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:55 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:20:55.529323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11ac12-e8ce-4424-b395-8bf8fcee4971 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.530748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dc11ac12-e8ce-4424-b395-8bf8fcee4971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:55.543873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc11ac12-e8ce-4424-b395-8bf8fcee4971 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.549997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.550934 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.551268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.551550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] PATH_INFO: `/v3/users/283c4b50a6a74a2685e0a05293bc369c` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.552815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] RBAC: Authorizing `identity:delete_user(user_id=283c4b50a6a74a2685e0a05293bc369c)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.556418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:55.797085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '283c4b50a6a74a2685e0a05293bc369c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.809222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '283c4b50a6a74a2685e0a05293bc369c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.815872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '283c4b50a6a74a2685e0a05293bc369c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.816595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '283c4b50a6a74a2685e0a05293bc369c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.906612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb1d1-d859-475d-9020-ed914d48f67e service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:55.908036 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-051bb1d1-d859-475d-9020-ed914d48f67e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:55.921628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '283c4b50a6a74a2685e0a05293bc369c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:55.926758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051bb1d1-d859-475d-9020-ed914d48f67e service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:55.930303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1064/2136] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:55 2021] DELETE /identity/v3/users/283c4b50a6a74a2685e0a05293bc369c => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:55.934834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:55.935872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:55.936187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:55.936516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] PATH_INFO: `/v3/projects/cc710e4a7fee41ea864d1729f98b7ee5` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:55.937790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc710e4a7fee41ea864d1729f98b7ee5)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:55.939808 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.049337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc710e4a7fee41ea864d1729f98b7ee5', 'request_id': 'req-567bb7fb-c369-4245-a8f2-4d07f916b387'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.057399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc710e4a7fee41ea864d1729f98b7ee5', 'request_id': 'req-567bb7fb-c369-4245-a8f2-4d07f916b387'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.062925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc710e4a7fee41ea864d1729f98b7ee5', 'request_id': 'req-567bb7fb-c369-4245-a8f2-4d07f916b387'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.143799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] The token cache is being invalidate because project cc710e4a7fee41ea864d1729f98b7ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:56.144107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.144708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.146286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1073/2137] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:55 2021] DELETE /identity/v3/projects/cc710e4a7fee41ea864d1729f98b7ee5 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:56.150873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.152296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:56.209105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.211442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:56.215042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402c7ea-155b-4f2b-9a6c-43cd54814c76 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.283805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.284666 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.284939 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.285250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] PATH_INFO: `/v3/users/1f1bd1bb3fe84bc88ad0c5644e87edd4` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.286434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f1bd1bb3fe84bc88ad0c5644e87edd4)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.288316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.289428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567bb7fb-c369-4245-a8f2-4d07f916b387 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.294120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.294966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.295248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.295517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] PATH_INFO: `/v3/projects/e093f4259be443e4bf66194aff0e408f` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.296816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e093f4259be443e4bf66194aff0e408f)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.298791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.519107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f1bd1bb3fe84bc88ad0c5644e87edd4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.523043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e093f4259be443e4bf66194aff0e408f', 'request_id': 'req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.531188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e093f4259be443e4bf66194aff0e408f', 'request_id': 'req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.533272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f1bd1bb3fe84bc88ad0c5644e87edd4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.538371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e093f4259be443e4bf66194aff0e408f', 'request_id': 'req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.541223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f1bd1bb3fe84bc88ad0c5644e87edd4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.546436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f1bd1bb3fe84bc88ad0c5644e87edd4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.602258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] The token cache is being invalidate because project e093f4259be443e4bf66194aff0e408f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:56.602605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.607817 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.607817 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1074/2138] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:56 2021] DELETE /identity/v3/projects/e093f4259be443e4bf66194aff0e408f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:56.609204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:56.610801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:56.658799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f1bd1bb3fe84bc88ad0c5644e87edd4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.671081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1065/2139] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:56 2021] DELETE /identity/v3/users/1f1bd1bb3fe84bc88ad0c5644e87edd4 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:20:56.703167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a128e-f95a-46e3-8da2-ef7f67ddcdeb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:56.777611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:56.778542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:56.778824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:56.779098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] PATH_INFO: `/v3/users/e325602fa35d4a5fbba0f82c88d12371` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:56.780333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e325602fa35d4a5fbba0f82c88d12371)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:56.782272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:56.981775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e325602fa35d4a5fbba0f82c88d12371'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:56.994769 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e325602fa35d4a5fbba0f82c88d12371'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.001501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e325602fa35d4a5fbba0f82c88d12371'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.115571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e325602fa35d4a5fbba0f82c88d12371'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.116269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e325602fa35d4a5fbba0f82c88d12371'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.122693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1075/2140] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:20:56 2021] DELETE /identity/v3/users/e325602fa35d4a5fbba0f82c88d12371 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:57.177256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.182866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:57.198059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33368a-f9a1-469a-bb21-03db3d35c62c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.279288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.280295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.280573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.280865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] PATH_INFO: `/v3/projects/1bd51972c35042d3ba1efbd41ef04b5e` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.282137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bd51972c35042d3ba1efbd41ef04b5e)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.284182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.492988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bd51972c35042d3ba1efbd41ef04b5e', 'request_id': 'req-d69fd0ea-9241-489e-85e5-458641572df0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.499864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bd51972c35042d3ba1efbd41ef04b5e', 'request_id': 'req-d69fd0ea-9241-489e-85e5-458641572df0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.508856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bd51972c35042d3ba1efbd41ef04b5e', 'request_id': 'req-d69fd0ea-9241-489e-85e5-458641572df0'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.512147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.513625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:57.527206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec96fe-b3a9-4633-b8cf-6afb73cd2edd admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.584332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] The token cache is being invalidate because project 1bd51972c35042d3ba1efbd41ef04b5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:57.584617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.585272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d69fd0ea-9241-489e-85e5-458641572df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.586417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.586842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1066/2141] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:57 2021] DELETE /identity/v3/projects/1bd51972c35042d3ba1efbd41ef04b5e => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:57.587385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.587669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.587940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] PATH_INFO: `/v3/projects/32623a2f72f14f469dbcc3d202f0453c` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.589152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32623a2f72f14f469dbcc3d202f0453c)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.591368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.592879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399ab6a-a167-4d23-8794-0240662ea1f5 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.593323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399ab6a-a167-4d23-8794-0240662ea1f5 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.593687 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399ab6a-a167-4d23-8794-0240662ea1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.612461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e399ab6a-a167-4d23-8794-0240662ea1f5 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:57.614263 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e399ab6a-a167-4d23-8794-0240662ea1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:57.623655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1067/2142] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:20:57.637638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308acd97-d180-4a31-96c1-ba61094ef4e8 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.637915 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308acd97-d180-4a31-96c1-ba61094ef4e8 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.638217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308acd97-d180-4a31-96c1-ba61094ef4e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.656568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-308acd97-d180-4a31-96c1-ba61094ef4e8 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:57.657767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-308acd97-d180-4a31-96c1-ba61094ef4e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:57.666464 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1068/2143] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:57.670617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308acd97-d180-4a31-96c1-ba61094ef4e8 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.679448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308acd97-d180-4a31-96c1-ba61094ef4e8 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.684063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da852c-2961-46dd-b168-2cfaa7a25b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.684688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da852c-2961-46dd-b168-2cfaa7a25b94 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.684957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da852c-2961-46dd-b168-2cfaa7a25b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.685221 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7da852c-2961-46dd-b168-2cfaa7a25b94 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.685971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da852c-2961-46dd-b168-2cfaa7a25b94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:57.686304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da852c-2961-46dd-b168-2cfaa7a25b94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.687848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7da852c-2961-46dd-b168-2cfaa7a25b94 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.700366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1069/2144] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:57.704423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da852c-2961-46dd-b168-2cfaa7a25b94 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.707129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32623a2f72f14f469dbcc3d202f0453c', 'request_id': 'req-b864ec8a-755b-4a8d-9962-35be6367717e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.714799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7da852c-2961-46dd-b168-2cfaa7a25b94 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.714949 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32623a2f72f14f469dbcc3d202f0453c', 'request_id': 'req-b864ec8a-755b-4a8d-9962-35be6367717e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.720976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32623a2f72f14f469dbcc3d202f0453c', 'request_id': 'req-b864ec8a-755b-4a8d-9962-35be6367717e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.773602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38484240-5e15-4d33-a8f3-0bdd660d7d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.774314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38484240-5e15-4d33-a8f3-0bdd660d7d7d admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.774702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38484240-5e15-4d33-a8f3-0bdd660d7d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.775136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38484240-5e15-4d33-a8f3-0bdd660d7d7d admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.775838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38484240-5e15-4d33-a8f3-0bdd660d7d7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.778053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38484240-5e15-4d33-a8f3-0bdd660d7d7d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:57.799648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] The token cache is being invalidate because project 32623a2f72f14f469dbcc3d202f0453c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:20:57.799924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.800561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b864ec8a-755b-4a8d-9962-35be6367717e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:20:57.802131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1076/2145] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:20:57 2021] DELETE /identity/v3/projects/32623a2f72f14f469dbcc3d202f0453c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:57.808035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b6e45-fa5c-4596-b6e5-631a52bc85ee None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.808348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b6e45-fa5c-4596-b6e5-631a52bc85ee None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.808693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1b6e45-fa5c-4596-b6e5-631a52bc85ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.829096 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-fd1b6e45-fa5c-4596-b6e5-631a52bc85ee None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:57.830396 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fd1b6e45-fa5c-4596-b6e5-631a52bc85ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:57.840080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1077/2146] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:57.847773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723917-085c-4146-bcf4-a3e364e9d790 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.848028 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723917-085c-4146-bcf4-a3e364e9d790 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.848302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723917-085c-4146-bcf4-a3e364e9d790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.869394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9b723917-085c-4146-bcf4-a3e364e9d790 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:57.870917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9b723917-085c-4146-bcf4-a3e364e9d790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:57.883751 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1078/2147] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:57.887573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1070/2148] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:57 2021] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:20:57.888363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b723917-085c-4146-bcf4-a3e364e9d790 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.888536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38484240-5e15-4d33-a8f3-0bdd660d7d7d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:57.893880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-38484240-5e15-4d33-a8f3-0bdd660d7d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:57.907584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b723917-085c-4146-bcf4-a3e364e9d790 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:57.989994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80fd3-914a-4994-9cec-c769734d5bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:57.990674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80fd3-914a-4994-9cec-c769734d5bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:57.990959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80fd3-914a-4994-9cec-c769734d5bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:57.991296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80fd3-914a-4994-9cec-c769734d5bd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:57.992168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80fd3-914a-4994-9cec-c769734d5bd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:20:57.992723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80fd3-914a-4994-9cec-c769734d5bd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:57.994596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80fd3-914a-4994-9cec-c769734d5bd2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.003870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38484240-5e15-4d33-a8f3-0bdd660d7d7d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.010118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a42e4a-56b6-4959-8097-95a02c8d82bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.011083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a42e4a-56b6-4959-8097-95a02c8d82bb admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.011362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a42e4a-56b6-4959-8097-95a02c8d82bb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.011701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a42e4a-56b6-4959-8097-95a02c8d82bb admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.012410 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a42e4a-56b6-4959-8097-95a02c8d82bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.013851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1079/2149] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:20:57 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:20:58.017657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80fd3-914a-4994-9cec-c769734d5bd2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.017798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a42e4a-56b6-4959-8097-95a02c8d82bb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.031460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80fd3-914a-4994-9cec-c769734d5bd2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.036580 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b93bf-6258-4455-b6f8-474bf5504966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.037407 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b93bf-6258-4455-b6f8-474bf5504966 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.037687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b93bf-6258-4455-b6f8-474bf5504966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.037957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b93bf-6258-4455-b6f8-474bf5504966 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.039312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b93bf-6258-4455-b6f8-474bf5504966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.041528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b93bf-6258-4455-b6f8-474bf5504966 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.110891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1071/2150] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:57 2021] POST /identity/v3/users => generated 284 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:58.115011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a42e4a-56b6-4959-8097-95a02c8d82bb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.125920 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a42e4a-56b6-4959-8097-95a02c8d82bb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.130664 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbedbc6-460b-4d10-9a66-bd239181d6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.131321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbedbc6-460b-4d10-9a66-bd239181d6b6 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.131594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbedbc6-460b-4d10-9a66-bd239181d6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.131893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbedbc6-460b-4d10-9a66-bd239181d6b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.132759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbedbc6-460b-4d10-9a66-bd239181d6b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.134363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbedbc6-460b-4d10-9a66-bd239181d6b6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.144610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1072/2151] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:58.149311 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbedbc6-460b-4d10-9a66-bd239181d6b6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.158835 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbedbc6-460b-4d10-9a66-bd239181d6b6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.164573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f36b-b710-4021-8ce6-0e10ad420966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.165317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f36b-b710-4021-8ce6-0e10ad420966 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.165597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f36b-b710-4021-8ce6-0e10ad420966 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.165866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1f36b-b710-4021-8ce6-0e10ad420966 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.166647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f36b-b710-4021-8ce6-0e10ad420966 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.168235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe1f36b-b710-4021-8ce6-0e10ad420966 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.179207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1073/2152] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:20:58.183068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f36b-b710-4021-8ce6-0e10ad420966 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.197729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1f36b-b710-4021-8ce6-0e10ad420966 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.202017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1080/2153] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:20:58 2021] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:58.203511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd712a36-927a-4641-a8d3-957c7c9b98e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.204395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd712a36-927a-4641-a8d3-957c7c9b98e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.204676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd712a36-927a-4641-a8d3-957c7c9b98e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.205020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd712a36-927a-4641-a8d3-957c7c9b98e9 admin admin] PATH_INFO: `/v3/projects/f35b38b27bcf44979bfa4b763eef135c/users/725e3f97cb1c403e896947c997fd351a/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.218019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b93bf-6258-4455-b6f8-474bf5504966 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.222724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd712a36-927a-4641-a8d3-957c7c9b98e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35b38b27bcf44979bfa4b763eef135c, user_id=725e3f97cb1c403e896947c997fd351a, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.225542 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd712a36-927a-4641-a8d3-957c7c9b98e9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.294132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b93bf-6258-4455-b6f8-474bf5504966 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.299394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d18b9-b3c7-4235-9a53-015d0085d413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.300056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d18b9-b3c7-4235-9a53-015d0085d413 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.300328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d18b9-b3c7-4235-9a53-015d0085d413 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.300595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d18b9-b3c7-4235-9a53-015d0085d413 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.301313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d18b9-b3c7-4235-9a53-015d0085d413 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.303204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d18b9-b3c7-4235-9a53-015d0085d413 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.344183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1074/2154] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:58 2021] PUT /identity/v3/projects/f35b38b27bcf44979bfa4b763eef135c/users/725e3f97cb1c403e896947c997fd351a/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:58.354662 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5aeea-0106-48e9-8adf-91ba4cb7d476 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.354981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5aeea-0106-48e9-8adf-91ba4cb7d476 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.355212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5aeea-0106-48e9-8adf-91ba4cb7d476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.400010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-23e5aeea-0106-48e9-8adf-91ba4cb7d476 None None] MFA Rules not processed for user `725e3f97cb1c403e896947c997fd351a`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:58.401463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-23e5aeea-0106-48e9-8adf-91ba4cb7d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:58.408885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1081/2155] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:20:58 2021] POST /identity/v3/users => generated 292 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:20:58.411624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d18b9-b3c7-4235-9a53-015d0085d413 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.434545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d18b9-b3c7-4235-9a53-015d0085d413 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.478463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1075/2156] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:58 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:58.499265 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5aeea-0106-48e9-8adf-91ba4cb7d476 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.500784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-23e5aeea-0106-48e9-8adf-91ba4cb7d476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:58.531112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43c36b-19c4-407f-9d40-42ef5cb48424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.531783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43c36b-19c4-407f-9d40-42ef5cb48424 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.532069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43c36b-19c4-407f-9d40-42ef5cb48424 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.532337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43c36b-19c4-407f-9d40-42ef5cb48424 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.533078 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43c36b-19c4-407f-9d40-42ef5cb48424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.534712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43c36b-19c4-407f-9d40-42ef5cb48424 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.545377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1082/2157] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:58.549167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43c36b-19c4-407f-9d40-42ef5cb48424 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.559150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43c36b-19c4-407f-9d40-42ef5cb48424 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.564026 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d576e2-0139-4934-ac2d-a1fdf3b51a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.564680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d576e2-0139-4934-ac2d-a1fdf3b51a6f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.564959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d576e2-0139-4934-ac2d-a1fdf3b51a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.565229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d576e2-0139-4934-ac2d-a1fdf3b51a6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.565961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d576e2-0139-4934-ac2d-a1fdf3b51a6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.567587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d576e2-0139-4934-ac2d-a1fdf3b51a6f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.572417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5aeea-0106-48e9-8adf-91ba4cb7d476 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.576042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9114a12d-245d-4f27-8ddf-3d1a5c34fb53 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f402e17093e4e99afda5ea019f335eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.576768 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a12d-245d-4f27-8ddf-3d1a5c34fb53 service glance] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.577077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a12d-245d-4f27-8ddf-3d1a5c34fb53 service glance] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.577355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9114a12d-245d-4f27-8ddf-3d1a5c34fb53 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.578273 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1083/2158] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:20:58.582346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d576e2-0139-4934-ac2d-a1fdf3b51a6f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.590638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114a12d-245d-4f27-8ddf-3d1a5c34fb53 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.592068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9114a12d-245d-4f27-8ddf-3d1a5c34fb53 service glance] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.593080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d576e2-0139-4934-ac2d-a1fdf3b51a6f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.598358 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc00332-947c-4271-9d52-04f97a8f8578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.599236 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc00332-947c-4271-9d52-04f97a8f8578 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.599567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc00332-947c-4271-9d52-04f97a8f8578 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.599766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc00332-947c-4271-9d52-04f97a8f8578 admin admin] PATH_INFO: `/v3/projects/5e37607855ec49b6af8f28274acba57b/users/d9f2d198479f41a5aede9109c9ae90a9/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.602655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1076/2159] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:20:58.618669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc00332-947c-4271-9d52-04f97a8f8578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e37607855ec49b6af8f28274acba57b, user_id=d9f2d198479f41a5aede9109c9ae90a9, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.622196 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc00332-947c-4271-9d52-04f97a8f8578 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.705780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1084/2160] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:20:58 2021] PUT /identity/v3/projects/5e37607855ec49b6af8f28274acba57b/users/d9f2d198479f41a5aede9109c9ae90a9/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:20:58.710996 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d140c3a-c72a-4b1e-a4f8-0d96fc83bf35 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.711345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d140c3a-c72a-4b1e-a4f8-0d96fc83bf35 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.711629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d140c3a-c72a-4b1e-a4f8-0d96fc83bf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.729960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-7d140c3a-c72a-4b1e-a4f8-0d96fc83bf35 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:20:58.731169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-7d140c3a-c72a-4b1e-a4f8-0d96fc83bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:58.798795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1077/2161] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:20:58 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:20:58.812658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc00332-947c-4271-9d52-04f97a8f8578 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:20:58.814585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2fc00332-947c-4271-9d52-04f97a8f8578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:20:58.881103 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc00332-947c-4271-9d52-04f97a8f8578 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:20:58.886174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9e096b-dd92-449a-8cd1-d5a02ffb8a4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:20:58.886951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e096b-dd92-449a-8cd1-d5a02ffb8a4c service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:20:58.887230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e096b-dd92-449a-8cd1-d5a02ffb8a4c service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:20:58.887676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9e096b-dd92-449a-8cd1-d5a02ffb8a4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:20:58.901050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e096b-dd92-449a-8cd1-d5a02ffb8a4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:20:58.902617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9e096b-dd92-449a-8cd1-d5a02ffb8a4c service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:20:58.913486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1085/2162] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:20:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:01.207344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d140c3a-c72a-4b1e-a4f8-0d96fc83bf35 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.210064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-7d140c3a-c72a-4b1e-a4f8-0d96fc83bf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:01.231530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d140c3a-c72a-4b1e-a4f8-0d96fc83bf35 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.242788 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.244329 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.244829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.245340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] PATH_INFO: `/v3/users/cda58252dd0b42359625192ff79f776e` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.246829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cda58252dd0b42359625192ff79f776e)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.248910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.473495 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda58252dd0b42359625192ff79f776e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:01.498350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda58252dd0b42359625192ff79f776e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:01.512316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda58252dd0b42359625192ff79f776e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:01.513126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda58252dd0b42359625192ff79f776e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:01.596327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda58252dd0b42359625192ff79f776e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:01.605526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1078/2163] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:01 2021] DELETE /identity/v3/users/cda58252dd0b42359625192ff79f776e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:01.610675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73d50-2564-466f-a4e0-b2c6cdaee081 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.611145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73d50-2564-466f-a4e0-b2c6cdaee081 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.611241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73d50-2564-466f-a4e0-b2c6cdaee081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.638277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-2db73d50-2564-466f-a4e0-b2c6cdaee081 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:01.639669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2db73d50-2564-466f-a4e0-b2c6cdaee081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:01.715436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:01.716723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1086/2164] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:01.717239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:01.817781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6ce58-8e1b-4f0b-9a56-83aef424650f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:01.822322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0fa26-c221-4f1f-9e3a-9ef69ddda76c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:01.822981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0fa26-c221-4f1f-9e3a-9ef69ddda76c service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:01.823257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0fa26-c221-4f1f-9e3a-9ef69ddda76c service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:01.823530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d0fa26-c221-4f1f-9e3a-9ef69ddda76c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:01.833268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0fa26-c221-4f1f-9e3a-9ef69ddda76c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:01.834792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d0fa26-c221-4f1f-9e3a-9ef69ddda76c service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:01.848479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1079/2165] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:02.375495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db73d50-2564-466f-a4e0-b2c6cdaee081 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.377384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2db73d50-2564-466f-a4e0-b2c6cdaee081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:02.393229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db73d50-2564-466f-a4e0-b2c6cdaee081 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.400086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.400284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.400828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.401179 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] PATH_INFO: `/v3/projects/c063600c38644af0b077c0890eec0367` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.402496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c063600c38644af0b077c0890eec0367)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.404477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.560896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c063600c38644af0b077c0890eec0367', 'request_id': 'req-0b27bce8-9dbb-40f4-8466-6e6236a15d84'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:02.567857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c063600c38644af0b077c0890eec0367', 'request_id': 'req-0b27bce8-9dbb-40f4-8466-6e6236a15d84'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:02.576434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c063600c38644af0b077c0890eec0367', 'request_id': 'req-0b27bce8-9dbb-40f4-8466-6e6236a15d84'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:02.653716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] The token cache is being invalidate because project c063600c38644af0b077c0890eec0367 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:02.654377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:02.654924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:02.664236 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1087/2166] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:02 2021] DELETE /identity/v3/projects/c063600c38644af0b077c0890eec0367 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:02.664418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0fa26-c221-4f1f-9e3a-9ef69ddda76c service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:02.675785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d0fa26-c221-4f1f-9e3a-9ef69ddda76c service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:02.752746 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:02.753625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:02.753900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:02.754216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] PATH_INFO: `/v3/users/4ea4c386a8ce4eb6bfee3a8f3f3c0c50` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:02.755561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ea4c386a8ce4eb6bfee3a8f3f3c0c50)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:02.758409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:02.984769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ea4c386a8ce4eb6bfee3a8f3f3c0c50'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:02.999280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ea4c386a8ce4eb6bfee3a8f3f3c0c50'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:03.009075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ea4c386a8ce4eb6bfee3a8f3f3c0c50'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:03.009902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ea4c386a8ce4eb6bfee3a8f3f3c0c50'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:03.098606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c08ddbea-e7fe-41d8-95dd-b1d83a348911 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ea4c386a8ce4eb6bfee3a8f3f3c0c50'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:03.106345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1080/2167] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:02 2021] DELETE /identity/v3/users/4ea4c386a8ce4eb6bfee3a8f3f3c0c50 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:21:03.648964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:03.650604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:03.668303 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b27bce8-9dbb-40f4-8466-6e6236a15d84 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:03.797281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:03.799101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:03.800715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:03.800715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] PATH_INFO: `/v3/projects/86acbcdbc133440c8fbefeec037ec811` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:03.801848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86acbcdbc133440c8fbefeec037ec811)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:03.805360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:03.964499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86acbcdbc133440c8fbefeec037ec811', 'request_id': 'req-d4dab12b-ebde-431f-9295-7ed0382708f8'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:03.975271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86acbcdbc133440c8fbefeec037ec811', 'request_id': 'req-d4dab12b-ebde-431f-9295-7ed0382708f8'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:03.992648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86acbcdbc133440c8fbefeec037ec811', 'request_id': 'req-d4dab12b-ebde-431f-9295-7ed0382708f8'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:04.081427 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] The token cache is being invalidate because project 86acbcdbc133440c8fbefeec037ec811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:04.081718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:04.082357 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d4dab12b-ebde-431f-9295-7ed0382708f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:04.083878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1088/2168] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:03 2021] DELETE /identity/v3/projects/86acbcdbc133440c8fbefeec037ec811 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:04.089792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa52e9-8b2f-41e7-8bdd-430a97c62606 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.090334 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa52e9-8b2f-41e7-8bdd-430a97c62606 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.090523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aa52e9-8b2f-41e7-8bdd-430a97c62606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.109635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-52aa52e9-8b2f-41e7-8bdd-430a97c62606 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:04.110997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-52aa52e9-8b2f-41e7-8bdd-430a97c62606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:04.186117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1081/2169] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:04.192399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c71df8-cc13-4525-8995-16ae5ab2ac38 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.193315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c71df8-cc13-4525-8995-16ae5ab2ac38 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.193763 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c71df8-cc13-4525-8995-16ae5ab2ac38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.215293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-53c71df8-cc13-4525-8995-16ae5ab2ac38 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:04.216503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-53c71df8-cc13-4525-8995-16ae5ab2ac38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:04.243939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1089/2170] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:04.248224 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa52e9-8b2f-41e7-8bdd-430a97c62606 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:04.265736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aa52e9-8b2f-41e7-8bdd-430a97c62606 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:04.282889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387335c-3b69-41a4-8dd2-8a5c16a3e243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:04.283794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387335c-3b69-41a4-8dd2-8a5c16a3e243 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.284065 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387335c-3b69-41a4-8dd2-8a5c16a3e243 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.284550 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4387335c-3b69-41a4-8dd2-8a5c16a3e243 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.285317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387335c-3b69-41a4-8dd2-8a5c16a3e243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:04.285812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387335c-3b69-41a4-8dd2-8a5c16a3e243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:04.287700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4387335c-3b69-41a4-8dd2-8a5c16a3e243 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:04.303554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1082/2171] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:21:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:04.308575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c71df8-cc13-4525-8995-16ae5ab2ac38 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:04.319054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c71df8-cc13-4525-8995-16ae5ab2ac38 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:04.325211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e7f3a-a0a1-4345-884d-98e980740293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:04.325211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e7f3a-a0a1-4345-884d-98e980740293 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.325776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e7f3a-a0a1-4345-884d-98e980740293 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.326087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70e7f3a-a0a1-4345-884d-98e980740293 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.326799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e7f3a-a0a1-4345-884d-98e980740293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:04.328710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70e7f3a-a0a1-4345-884d-98e980740293 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:04.539510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1090/2172] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:04 2021] POST /identity/v3/projects => generated 367 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:04.542267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387335c-3b69-41a4-8dd2-8a5c16a3e243 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:04.556467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4387335c-3b69-41a4-8dd2-8a5c16a3e243 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:04.658489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb92b-b3f4-4976-8a5b-9a4f07003e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:04.659715 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb92b-b3f4-4976-8a5b-9a4f07003e73 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.659995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb92b-b3f4-4976-8a5b-9a4f07003e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.660370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5fb92b-b3f4-4976-8a5b-9a4f07003e73 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.661088 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb92b-b3f4-4976-8a5b-9a4f07003e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:04.663697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5fb92b-b3f4-4976-8a5b-9a4f07003e73 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:04.778226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1083/2173] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:21:04 2021] POST /identity/v3/users => generated 284 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:04.780102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e7f3a-a0a1-4345-884d-98e980740293 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:04.811908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70e7f3a-a0a1-4345-884d-98e980740293 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:04.834531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123375cc-7e87-4c5a-b3a6-5f2b5d3b5f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:04.836909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123375cc-7e87-4c5a-b3a6-5f2b5d3b5f9c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.839005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123375cc-7e87-4c5a-b3a6-5f2b5d3b5f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.844945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123375cc-7e87-4c5a-b3a6-5f2b5d3b5f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.856472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123375cc-7e87-4c5a-b3a6-5f2b5d3b5f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:04.858625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123375cc-7e87-4c5a-b3a6-5f2b5d3b5f9c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:04.877764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1091/2174] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:04 2021] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:04.878451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb92b-b3f4-4976-8a5b-9a4f07003e73 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:04.900107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5fb92b-b3f4-4976-8a5b-9a4f07003e73 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:04.912493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587aa71-c24c-42c6-8422-1f2c7bae3710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:04.913764 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587aa71-c24c-42c6-8422-1f2c7bae3710 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.914195 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587aa71-c24c-42c6-8422-1f2c7bae3710 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.914574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587aa71-c24c-42c6-8422-1f2c7bae3710 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:04.915854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587aa71-c24c-42c6-8422-1f2c7bae3710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:04.922775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587aa71-c24c-42c6-8422-1f2c7bae3710 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:04.944629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1084/2175] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:04 2021] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:04.949024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123375cc-7e87-4c5a-b3a6-5f2b5d3b5f9c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:04.963525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123375cc-7e87-4c5a-b3a6-5f2b5d3b5f9c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:04.968820 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababfd9a-1fcf-4e84-bfe3-cb293c12f5c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:04.970061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababfd9a-1fcf-4e84-bfe3-cb293c12f5c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:04.970998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababfd9a-1fcf-4e84-bfe3-cb293c12f5c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:04.971507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababfd9a-1fcf-4e84-bfe3-cb293c12f5c7 admin admin] PATH_INFO: `/v3/projects/d86747bf295a4ac9968d851f2baf15e3/users/af8cf61d4d8348aaaaddf4c1b075893f/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.015279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababfd9a-1fcf-4e84-bfe3-cb293c12f5c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d86747bf295a4ac9968d851f2baf15e3, user_id=af8cf61d4d8348aaaaddf4c1b075893f, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.017935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ababfd9a-1fcf-4e84-bfe3-cb293c12f5c7 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.113960 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1092/2176] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:04 2021] PUT /identity/v3/projects/d86747bf295a4ac9968d851f2baf15e3/users/af8cf61d4d8348aaaaddf4c1b075893f/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:05.125524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa80d6-29f3-4867-97e4-08258c2e2728 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.126264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa80d6-29f3-4867-97e4-08258c2e2728 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.126264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fa80d6-29f3-4867-97e4-08258c2e2728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.157170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-39fa80d6-29f3-4867-97e4-08258c2e2728 None None] MFA Rules not processed for user `af8cf61d4d8348aaaaddf4c1b075893f`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:05.159292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-39fa80d6-29f3-4867-97e4-08258c2e2728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:05.263541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1085/2177] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:05 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:05.267831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababfd9a-1fcf-4e84-bfe3-cb293c12f5c7 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.367372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababfd9a-1fcf-4e84-bfe3-cb293c12f5c7 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.378185 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13e8d5-ace2-4ec5-9767-d7ee10614a10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.378660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13e8d5-ace2-4ec5-9767-d7ee10614a10 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.378936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13e8d5-ace2-4ec5-9767-d7ee10614a10 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.379248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13e8d5-ace2-4ec5-9767-d7ee10614a10 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.379909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13e8d5-ace2-4ec5-9767-d7ee10614a10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.382599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13e8d5-ace2-4ec5-9767-d7ee10614a10 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.536331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45d177-076c-4ddb-b597-78ac47981db9 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.536875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45d177-076c-4ddb-b597-78ac47981db9 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.537308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac45d177-076c-4ddb-b597-78ac47981db9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.567277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ac45d177-076c-4ddb-b597-78ac47981db9 None None] MFA Rules not processed for user `d9f2d198479f41a5aede9109c9ae90a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:05.568629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ac45d177-076c-4ddb-b597-78ac47981db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:05.643578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1086/2178] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:05 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:05.652968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45d177-076c-4ddb-b597-78ac47981db9 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.654859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1093/2179] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:05 2021] POST /identity/v3/projects => generated 367 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:05.655386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ac45d177-076c-4ddb-b597-78ac47981db9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:05.658581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13e8d5-ace2-4ec5-9767-d7ee10614a10 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.670972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac45d177-076c-4ddb-b597-78ac47981db9 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.731174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13e8d5-ace2-4ec5-9767-d7ee10614a10 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.736826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bafc5-94e4-4965-95a0-81da447a219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.737513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bafc5-94e4-4965-95a0-81da447a219a admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.737786 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bafc5-94e4-4965-95a0-81da447a219a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.738090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bafc5-94e4-4965-95a0-81da447a219a admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.739033 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bafc5-94e4-4965-95a0-81da447a219a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.742330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bafc5-94e4-4965-95a0-81da447a219a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.750227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce5202-e3ed-45b0-9d12-3802654b62bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.751126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce5202-e3ed-45b0-9d12-3802654b62bf admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.752070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce5202-e3ed-45b0-9d12-3802654b62bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.752070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ce5202-e3ed-45b0-9d12-3802654b62bf admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.752675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce5202-e3ed-45b0-9d12-3802654b62bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.756257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ce5202-e3ed-45b0-9d12-3802654b62bf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.856101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1094/2180] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:21:05 2021] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:05.867644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bafc5-94e4-4965-95a0-81da447a219a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.883742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bafc5-94e4-4965-95a0-81da447a219a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.889120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699664-83a1-4869-97bd-15e3f05978a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:05.890191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699664-83a1-4869-97bd-15e3f05978a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:05.891740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699664-83a1-4869-97bd-15e3f05978a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:05.894674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42699664-83a1-4869-97bd-15e3f05978a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:05.894674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42699664-83a1-4869-97bd-15e3f05978a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:05.895012 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42699664-83a1-4869-97bd-15e3f05978a4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:05.906014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1095/2181] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:05 2021] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:05.910261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699664-83a1-4869-97bd-15e3f05978a4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:05.925840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1087/2182] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:05 2021] POST /identity/v3/projects => generated 385 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:05.926057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42699664-83a1-4869-97bd-15e3f05978a4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:05.926999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce5202-e3ed-45b0-9d12-3802654b62bf admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.028341 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ce5202-e3ed-45b0-9d12-3802654b62bf admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.028477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03429153-a888-4651-b21a-4e2c87587593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.028477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03429153-a888-4651-b21a-4e2c87587593 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.028477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03429153-a888-4651-b21a-4e2c87587593 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.028477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03429153-a888-4651-b21a-4e2c87587593 admin admin] PATH_INFO: `/v3/projects/491e34ba308c41d0a62afa9eb70f3d9c/users/07bff314f3034b7c93514ab50efea0c4/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.031100 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b0a62-8bf6-4e63-a354-23b4e5255496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.031799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b0a62-8bf6-4e63-a354-23b4e5255496 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.036167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b0a62-8bf6-4e63-a354-23b4e5255496 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.040709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652b0a62-8bf6-4e63-a354-23b4e5255496 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.041540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b0a62-8bf6-4e63-a354-23b4e5255496 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.047798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652b0a62-8bf6-4e63-a354-23b4e5255496 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.076964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03429153-a888-4651-b21a-4e2c87587593 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491e34ba308c41d0a62afa9eb70f3d9c, user_id=07bff314f3034b7c93514ab50efea0c4, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.079870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03429153-a888-4651-b21a-4e2c87587593 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.173075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1088/2183] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:21:05 2021] POST /identity/v3/users => generated 299 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:06.176986 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b0a62-8bf6-4e63-a354-23b4e5255496 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.187767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652b0a62-8bf6-4e63-a354-23b4e5255496 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.192721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271bab5-905b-4fde-b3fc-8e99689f1f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.193382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271bab5-905b-4fde-b3fc-8e99689f1f2b admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.193776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271bab5-905b-4fde-b3fc-8e99689f1f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.194067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271bab5-905b-4fde-b3fc-8e99689f1f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.195553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271bab5-905b-4fde-b3fc-8e99689f1f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.197260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271bab5-905b-4fde-b3fc-8e99689f1f2b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.207947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1089/2184] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:06.212591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271bab5-905b-4fde-b3fc-8e99689f1f2b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.213068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1096/2185] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:05 2021] PUT /identity/v3/projects/491e34ba308c41d0a62afa9eb70f3d9c/users/07bff314f3034b7c93514ab50efea0c4/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:06.216674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03429153-a888-4651-b21a-4e2c87587593 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.223951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271bab5-905b-4fde-b3fc-8e99689f1f2b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.282778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03429153-a888-4651-b21a-4e2c87587593 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.284466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231ed32-cece-423b-85f0-ddeaa1ba8280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.285371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231ed32-cece-423b-85f0-ddeaa1ba8280 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.285669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231ed32-cece-423b-85f0-ddeaa1ba8280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.285937 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231ed32-cece-423b-85f0-ddeaa1ba8280 admin admin] PATH_INFO: `/v3/projects/10960a4e2cc44f2a950118db5f195c6a/users/256bcf05d5f841a381f7af77eaa7d2e5/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.287530 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52937115-dd7c-4b5a-963f-df905ed8b47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.288569 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937115-dd7c-4b5a-963f-df905ed8b47b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.288958 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937115-dd7c-4b5a-963f-df905ed8b47b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.289228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52937115-dd7c-4b5a-963f-df905ed8b47b admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.290011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52937115-dd7c-4b5a-963f-df905ed8b47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.291632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52937115-dd7c-4b5a-963f-df905ed8b47b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.300494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231ed32-cece-423b-85f0-ddeaa1ba8280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10960a4e2cc44f2a950118db5f195c6a, user_id=256bcf05d5f841a381f7af77eaa7d2e5, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.301540 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1097/2186] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:06.303149 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231ed32-cece-423b-85f0-ddeaa1ba8280 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.305639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52937115-dd7c-4b5a-963f-df905ed8b47b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.315471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52937115-dd7c-4b5a-963f-df905ed8b47b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.326838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd0a807-8157-4428-9635-96d0acdb8552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.326838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0a807-8157-4428-9635-96d0acdb8552 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.326838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0a807-8157-4428-9635-96d0acdb8552 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.326838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd0a807-8157-4428-9635-96d0acdb8552 admin admin] PATH_INFO: `/v3/projects/491e34ba308c41d0a62afa9eb70f3d9c/users/07bff314f3034b7c93514ab50efea0c4/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.327136 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0a807-8157-4428-9635-96d0acdb8552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=491e34ba308c41d0a62afa9eb70f3d9c, user_id=07bff314f3034b7c93514ab50efea0c4, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.327627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd0a807-8157-4428-9635-96d0acdb8552 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.339152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1098/2187] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:06 2021] PUT /identity/v3/projects/491e34ba308c41d0a62afa9eb70f3d9c/users/07bff314f3034b7c93514ab50efea0c4/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:21:06.350149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81547da-7560-40ba-9739-8663572089b8 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.350444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81547da-7560-40ba-9739-8663572089b8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.350861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81547da-7560-40ba-9739-8663572089b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.378255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e81547da-7560-40ba-9739-8663572089b8 None None] MFA Rules not processed for user `07bff314f3034b7c93514ab50efea0c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:06.379470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e81547da-7560-40ba-9739-8663572089b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:06.413556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1090/2188] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:06 2021] PUT /identity/v3/projects/10960a4e2cc44f2a950118db5f195c6a/users/256bcf05d5f841a381f7af77eaa7d2e5/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:21:06.413964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231ed32-cece-423b-85f0-ddeaa1ba8280 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.453358 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1099/2189] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:06 2021] POST /identity/v3/auth/tokens => generated 3454 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:06.467462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81547da-7560-40ba-9739-8663572089b8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.468968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e81547da-7560-40ba-9739-8663572089b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:06.496028 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231ed32-cece-423b-85f0-ddeaa1ba8280 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.501171 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791269d-49e9-40d4-a2b4-f538d018c57a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.501837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791269d-49e9-40d4-a2b4-f538d018c57a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.505288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791269d-49e9-40d4-a2b4-f538d018c57a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.505288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791269d-49e9-40d4-a2b4-f538d018c57a admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.505288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791269d-49e9-40d4-a2b4-f538d018c57a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.505288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0791269d-49e9-40d4-a2b4-f538d018c57a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.515161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1091/2190] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:06.519218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791269d-49e9-40d4-a2b4-f538d018c57a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.531469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81547da-7560-40ba-9739-8663572089b8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.532139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791269d-49e9-40d4-a2b4-f538d018c57a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.538875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7cbda-ebbf-435d-8963-92847d6e9731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.539956 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7cbda-ebbf-435d-8963-92847d6e9731 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.540237 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7cbda-ebbf-435d-8963-92847d6e9731 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.540516 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c7cbda-ebbf-435d-8963-92847d6e9731 admin admin] PATH_INFO: `/v3/projects/10960a4e2cc44f2a950118db5f195c6a/users/256bcf05d5f841a381f7af77eaa7d2e5/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.543745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7cbda-ebbf-435d-8963-92847d6e9731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10960a4e2cc44f2a950118db5f195c6a, user_id=256bcf05d5f841a381f7af77eaa7d2e5, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.546405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c7cbda-ebbf-435d-8963-92847d6e9731 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.557465 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1092/2191] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:06 2021] PUT /identity/v3/projects/10960a4e2cc44f2a950118db5f195c6a/users/256bcf05d5f841a381f7af77eaa7d2e5/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:06.588815 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f327e-c1e7-4a51-a017-5a63a687ac02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.589557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f327e-c1e7-4a51-a017-5a63a687ac02 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.589765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f327e-c1e7-4a51-a017-5a63a687ac02 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.590048 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f327e-c1e7-4a51-a017-5a63a687ac02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.650263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f327e-c1e7-4a51-a017-5a63a687ac02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.651766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f327e-c1e7-4a51-a017-5a63a687ac02 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.661682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1100/2192] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/auth/tokens => generated 3454 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:21:06.821960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7cbda-ebbf-435d-8963-92847d6e9731 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:06.886152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c7cbda-ebbf-435d-8963-92847d6e9731 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:06.890747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e7e8a-5893-4fbf-9fb2-a9d248f62490 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:06.891386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e7e8a-5893-4fbf-9fb2-a9d248f62490 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:06.891813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e7e8a-5893-4fbf-9fb2-a9d248f62490 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:06.892107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e7e8a-5893-4fbf-9fb2-a9d248f62490 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:06.961986 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e7e8a-5893-4fbf-9fb2-a9d248f62490 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:06.964177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e7e8a-5893-4fbf-9fb2-a9d248f62490 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:06.976127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1093/2193] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:06 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:13.221002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f327e-c1e7-4a51-a017-5a63a687ac02 service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.233694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f327e-c1e7-4a51-a017-5a63a687ac02 service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:13.369235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:13.370223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.370507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.370791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] PATH_INFO: `/v3/users/af8cf61d4d8348aaaaddf4c1b075893f` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.375504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8cf61d4d8348aaaaddf4c1b075893f)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:13.377604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:13.635418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8cf61d4d8348aaaaddf4c1b075893f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:13.660768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8cf61d4d8348aaaaddf4c1b075893f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:13.671688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8cf61d4d8348aaaaddf4c1b075893f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:13.778932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8cf61d4d8348aaaaddf4c1b075893f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:13.780096 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-976e6a3e-c7b6-4762-bebb-3b1c5f9ff087 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8cf61d4d8348aaaaddf4c1b075893f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:13.790995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1101/2194] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:13 2021] DELETE /identity/v3/users/af8cf61d4d8348aaaaddf4c1b075893f => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:13.795745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45040-4fd0-4c52-9ad8-9c80f4c59b55 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.795745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45040-4fd0-4c52-9ad8-9c80f4c59b55 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.796498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae45040-4fd0-4c52-9ad8-9c80f4c59b55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.823282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-eae45040-4fd0-4c52-9ad8-9c80f4c59b55 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:13.824909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-eae45040-4fd0-4c52-9ad8-9c80f4c59b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:13.879422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dbc68-da06-4fd8-ac64-d9de01aed9b8 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:13.879853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dbc68-da06-4fd8-ac64-d9de01aed9b8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:13.880317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241dbc68-da06-4fd8-ac64-d9de01aed9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:13.905026 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1094/2195] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:13.912045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-241dbc68-da06-4fd8-ac64-d9de01aed9b8 None None] MFA Rules not processed for user `256bcf05d5f841a381f7af77eaa7d2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:13.914664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-241dbc68-da06-4fd8-ac64-d9de01aed9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:13.923851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45040-4fd0-4c52-9ad8-9c80f4c59b55 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:13.925744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-eae45040-4fd0-4c52-9ad8-9c80f4c59b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:14.015995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1102/2196] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:13 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:14.017111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae45040-4fd0-4c52-9ad8-9c80f4c59b55 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.027651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dbc68-da06-4fd8-ac64-d9de01aed9b8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.029067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-241dbc68-da06-4fd8-ac64-d9de01aed9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:14.029887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2c7422-138f-454d-969b-cdf3b15688cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.030960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c7422-138f-454d-969b-cdf3b15688cf service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.031266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c7422-138f-454d-969b-cdf3b15688cf service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.031585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2c7422-138f-454d-969b-cdf3b15688cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.044701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c7422-138f-454d-969b-cdf3b15688cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.046239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2c7422-138f-454d-969b-cdf3b15688cf service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.056977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1095/2197] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:13 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:21:14.090147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241dbc68-da06-4fd8-ac64-d9de01aed9b8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.093800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f402e17093e4e99afda5ea019f335eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.094475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.094753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.095020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.096788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:14.168843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.170327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.181239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1103/2198] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:21:14.450004 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e6c7-66f7-470a-92a1-c733d233051c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.450399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e6c7-66f7-470a-92a1-c733d233051c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.450676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0e6c7-66f7-470a-92a1-c733d233051c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.468863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-55f0e6c7-66f7-470a-92a1-c733d233051c None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:14.470085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-55f0e6c7-66f7-470a-92a1-c733d233051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:14.523478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1096/2199] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:21:14 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:14.529836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.533142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:14.551905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa5b8b-193c-4d2d-bdae-50f50f18b991 service glance] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.572562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.573795 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.574199 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.574563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] PATH_INFO: `/v3/projects/d86747bf295a4ac9968d851f2baf15e3` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.576929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d86747bf295a4ac9968d851f2baf15e3)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.579713 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.582082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e6c7-66f7-470a-92a1-c733d233051c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.587425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-55f0e6c7-66f7-470a-92a1-c733d233051c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:14.670448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0e6c7-66f7-470a-92a1-c733d233051c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:14.675830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3de7f-d53d-4944-b981-7fc28e645640 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:14.676479 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3de7f-d53d-4944-b981-7fc28e645640 service swift] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:14.676765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3de7f-d53d-4944-b981-7fc28e645640 service swift] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:14.677036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3de7f-d53d-4944-b981-7fc28e645640 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:14.685186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3de7f-d53d-4944-b981-7fc28e645640 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:14.686791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3de7f-d53d-4944-b981-7fc28e645640 service swift] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:14.694998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1097/2200] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:21:14 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 01:21:14.782733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd86747bf295a4ac9968d851f2baf15e3', 'request_id': 'req-31dda90e-214b-4a11-a7f0-18c8e3e19d43'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:14.791159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd86747bf295a4ac9968d851f2baf15e3', 'request_id': 'req-31dda90e-214b-4a11-a7f0-18c8e3e19d43'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:14.797578 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd86747bf295a4ac9968d851f2baf15e3', 'request_id': 'req-31dda90e-214b-4a11-a7f0-18c8e3e19d43'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:14.888990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] The token cache is being invalidate because project d86747bf295a4ac9968d851f2baf15e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:14.889338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:14.890117 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:14.895896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1104/2201] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:14 2021] DELETE /identity/v3/projects/d86747bf295a4ac9968d851f2baf15e3 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:14.896646 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3de7f-d53d-4944-b981-7fc28e645640 service swift] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:14.908903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3de7f-d53d-4944-b981-7fc28e645640 service swift] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:15.005987 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:15.007383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:15.007655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:15.007925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] PATH_INFO: `/v3/users/07bff314f3034b7c93514ab50efea0c4` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:15.009305 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07bff314f3034b7c93514ab50efea0c4)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:15.011423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:15.232721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07bff314f3034b7c93514ab50efea0c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:15.260660 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07bff314f3034b7c93514ab50efea0c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:15.270617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07bff314f3034b7c93514ab50efea0c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:15.271393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07bff314f3034b7c93514ab50efea0c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:15.994938 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2e103d23-ad82-4c27-b784-afdbe26baa33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07bff314f3034b7c93514ab50efea0c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:16.005167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1098/2202] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:14 2021] DELETE /identity/v3/users/07bff314f3034b7c93514ab50efea0c4 => generated 0 bytes in 1109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:16.731868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:16.734322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:16.762584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dda90e-214b-4a11-a7f0-18c8e3e19d43 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:16.863143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:16.864263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:16.864659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:16.865031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] PATH_INFO: `/v3/projects/491e34ba308c41d0a62afa9eb70f3d9c` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:16.867226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=491e34ba308c41d0a62afa9eb70f3d9c)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:16.869398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:16.995925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '491e34ba308c41d0a62afa9eb70f3d9c', 'request_id': 'req-08405c2a-b23f-44b9-a7f9-f4913987c199'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:17.003822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '491e34ba308c41d0a62afa9eb70f3d9c', 'request_id': 'req-08405c2a-b23f-44b9-a7f9-f4913987c199'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:17.010221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '491e34ba308c41d0a62afa9eb70f3d9c', 'request_id': 'req-08405c2a-b23f-44b9-a7f9-f4913987c199'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:17.142443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] The token cache is being invalidate because project 491e34ba308c41d0a62afa9eb70f3d9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:17.142885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:17.143705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-08405c2a-b23f-44b9-a7f9-f4913987c199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:17.152175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b0b15-f533-4ac8-8069-20fbf410b8aa None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.152731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b0b15-f533-4ac8-8069-20fbf410b8aa None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.152847 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0b0b15-f533-4ac8-8069-20fbf410b8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.154533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1105/2203] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:16 2021] DELETE /identity/v3/projects/491e34ba308c41d0a62afa9eb70f3d9c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:17.192437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1d0b0b15-f533-4ac8-8069-20fbf410b8aa None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:17.193939 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1d0b0b15-f533-4ac8-8069-20fbf410b8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:17.310060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1099/2204] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:17.317753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf187a-aaeb-4963-826e-5f4f8caa1db2 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.318256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf187a-aaeb-4963-826e-5f4f8caa1db2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.318540 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcf187a-aaeb-4963-826e-5f4f8caa1db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.343058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-abcf187a-aaeb-4963-826e-5f4f8caa1db2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:17.344271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-abcf187a-aaeb-4963-826e-5f4f8caa1db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:17.358555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b0b15-f533-4ac8-8069-20fbf410b8aa None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.363526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1106/2205] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:17.368998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0b0b15-f533-4ac8-8069-20fbf410b8aa None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.379108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91f36b-6891-4964-b42c-67e084a700f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.380163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91f36b-6891-4964-b42c-67e084a700f0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.380602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91f36b-6891-4964-b42c-67e084a700f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.381030 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c91f36b-6891-4964-b42c-67e084a700f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.382606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91f36b-6891-4964-b42c-67e084a700f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:17.383089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91f36b-6891-4964-b42c-67e084a700f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.384841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c91f36b-6891-4964-b42c-67e084a700f0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.408644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf187a-aaeb-4963-826e-5f4f8caa1db2 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.430647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1100/2206] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:17.434328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcf187a-aaeb-4963-826e-5f4f8caa1db2 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.446298 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d64b9-5b38-483c-bb11-58221c967ed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.446986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d64b9-5b38-483c-bb11-58221c967ed7 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.447266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d64b9-5b38-483c-bb11-58221c967ed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.447537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7d64b9-5b38-483c-bb11-58221c967ed7 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.448487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d64b9-5b38-483c-bb11-58221c967ed7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.450507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7d64b9-5b38-483c-bb11-58221c967ed7 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.549272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1107/2207] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:17 2021] POST /identity/v3/projects => generated 391 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:17.554085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91f36b-6891-4964-b42c-67e084a700f0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.581665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c91f36b-6891-4964-b42c-67e084a700f0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.682846 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf72c3-4cc8-4594-8281-d7346b801030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.683709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf72c3-4cc8-4594-8281-d7346b801030 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.685977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf72c3-4cc8-4594-8281-d7346b801030 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.686468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf72c3-4cc8-4594-8281-d7346b801030 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.687200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf72c3-4cc8-4594-8281-d7346b801030 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.689859 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badf72c3-4cc8-4594-8281-d7346b801030 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.807234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1101/2208] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:21:17 2021] POST /identity/v3/users => generated 296 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:17.817535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d64b9-5b38-483c-bb11-58221c967ed7 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.838271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7d64b9-5b38-483c-bb11-58221c967ed7 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.848073 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d7d4-1142-4c83-ba58-2574eff0a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.849064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d7d4-1142-4c83-ba58-2574eff0a6f9 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.849582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d7d4-1142-4c83-ba58-2574eff0a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.850091 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15d7d4-1142-4c83-ba58-2574eff0a6f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.851694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15d7d4-1142-4c83-ba58-2574eff0a6f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.854014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca15d7d4-1142-4c83-ba58-2574eff0a6f9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.877487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1108/2209] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:17.882427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf72c3-4cc8-4594-8281-d7346b801030 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.899837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf72c3-4cc8-4594-8281-d7346b801030 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.911459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631b723-8097-4ad5-96d5-a585084b3826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.912328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631b723-8097-4ad5-96d5-a585084b3826 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.912650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631b723-8097-4ad5-96d5-a585084b3826 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.913507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631b723-8097-4ad5-96d5-a585084b3826 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.914804 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631b723-8097-4ad5-96d5-a585084b3826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.916414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631b723-8097-4ad5-96d5-a585084b3826 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:17.936451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1102/2210] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:17 2021] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:17.937287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d7d4-1142-4c83-ba58-2574eff0a6f9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:17.955682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15d7d4-1142-4c83-ba58-2574eff0a6f9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:17.963888 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c87d2c-7628-4049-ba0b-6c58661198e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:17.966636 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87d2c-7628-4049-ba0b-6c58661198e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:17.967140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87d2c-7628-4049-ba0b-6c58661198e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:17.967575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c87d2c-7628-4049-ba0b-6c58661198e6 admin admin] PATH_INFO: `/v3/projects/0223fbffaa7b4c9da7f6f18a3293797f/users/e4b7565ed5354a9daada7743649edda9/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:17.984919 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c87d2c-7628-4049-ba0b-6c58661198e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0223fbffaa7b4c9da7f6f18a3293797f, user_id=e4b7565ed5354a9daada7743649edda9, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:17.987941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c87d2c-7628-4049-ba0b-6c58661198e6 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:18.145560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1109/2211] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:17 2021] PUT /identity/v3/projects/0223fbffaa7b4c9da7f6f18a3293797f/users/e4b7565ed5354a9daada7743649edda9/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:21:18.168011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc003-4bf2-4bae-af82-ca598a1d8f47 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:18.168528 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc003-4bf2-4bae-af82-ca598a1d8f47 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:18.168652 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57cc003-4bf2-4bae-af82-ca598a1d8f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:18.236515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-b57cc003-4bf2-4bae-af82-ca598a1d8f47 None None] MFA Rules not processed for user `e4b7565ed5354a9daada7743649edda9`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:18.250234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b57cc003-4bf2-4bae-af82-ca598a1d8f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:18.358454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1103/2212] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:18 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:18.359236 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c87d2c-7628-4049-ba0b-6c58661198e6 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:18.441331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c87d2c-7628-4049-ba0b-6c58661198e6 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:18.446668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b2a83-f2e4-4da9-aec5-7bae4d906f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:18.447458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b2a83-f2e4-4da9-aec5-7bae4d906f78 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:18.447804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b2a83-f2e4-4da9-aec5-7bae4d906f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:18.453154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8b2a83-f2e4-4da9-aec5-7bae4d906f78 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:18.453998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b2a83-f2e4-4da9-aec5-7bae4d906f78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:18.456094 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8b2a83-f2e4-4da9-aec5-7bae4d906f78 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:18.720377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1110/2213] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:18 2021] POST /identity/v3/projects => generated 389 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:18.721776 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cc003-4bf2-4bae-af82-ca598a1d8f47 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:18.746935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57cc003-4bf2-4bae-af82-ca598a1d8f47 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:18.814283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841d522-f832-437c-bc40-4e01e895a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:18.815134 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d522-f832-437c-bc40-4e01e895a6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:18.815546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d522-f832-437c-bc40-4e01e895a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:18.815949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841d522-f832-437c-bc40-4e01e895a6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:18.816712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841d522-f832-437c-bc40-4e01e895a6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:18.818730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2841d522-f832-437c-bc40-4e01e895a6c7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:18.917514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1104/2214] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:21:18 2021] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:18.921444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b2a83-f2e4-4da9-aec5-7bae4d906f78 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:18.938320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8b2a83-f2e4-4da9-aec5-7bae4d906f78 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:18.945632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8770a5-19ed-4ad6-b60d-6b3131c366ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:18.946619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8770a5-19ed-4ad6-b60d-6b3131c366ba admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:18.947063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8770a5-19ed-4ad6-b60d-6b3131c366ba admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:18.947488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8770a5-19ed-4ad6-b60d-6b3131c366ba admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:18.948245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8770a5-19ed-4ad6-b60d-6b3131c366ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:18.949836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8770a5-19ed-4ad6-b60d-6b3131c366ba admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:18.961837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1111/2215] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:18 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:18.967529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841d522-f832-437c-bc40-4e01e895a6c7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:18.979061 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2841d522-f832-437c-bc40-4e01e895a6c7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:18.992778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69ef8-be0c-4b64-81c5-b71d31a1ec4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:18.993819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69ef8-be0c-4b64-81c5-b71d31a1ec4b admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:18.994128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69ef8-be0c-4b64-81c5-b71d31a1ec4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:18.994401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69ef8-be0c-4b64-81c5-b71d31a1ec4b admin admin] PATH_INFO: `/v3/projects/042d7bea7d4647efb26a862631ac3560/users/b9d202e26dd64cd2acfe23b45ccfd1dd/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.014778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd69ef8-be0c-4b64-81c5-b71d31a1ec4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=042d7bea7d4647efb26a862631ac3560, user_id=b9d202e26dd64cd2acfe23b45ccfd1dd, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.017500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd69ef8-be0c-4b64-81c5-b71d31a1ec4b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.100006 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1105/2216] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:18 2021] PUT /identity/v3/projects/042d7bea7d4647efb26a862631ac3560/users/b9d202e26dd64cd2acfe23b45ccfd1dd/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:21:19.104511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8770a5-19ed-4ad6-b60d-6b3131c366ba admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.116053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8770a5-19ed-4ad6-b60d-6b3131c366ba admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.183904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c641ff-6051-45d0-a8a2-0e6b29e8235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.184527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c641ff-6051-45d0-a8a2-0e6b29e8235e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.184813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c641ff-6051-45d0-a8a2-0e6b29e8235e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.185091 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c641ff-6051-45d0-a8a2-0e6b29e8235e admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.185879 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c641ff-6051-45d0-a8a2-0e6b29e8235e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.187480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c641ff-6051-45d0-a8a2-0e6b29e8235e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.200688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1112/2217] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:19.204729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69ef8-be0c-4b64-81c5-b71d31a1ec4b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.219064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69ef8-be0c-4b64-81c5-b71d31a1ec4b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.224798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c720f37-5c9e-4a50-a7f0-70d7abdf289b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.226247 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720f37-5c9e-4a50-a7f0-70d7abdf289b admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.226766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720f37-5c9e-4a50-a7f0-70d7abdf289b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.227259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c720f37-5c9e-4a50-a7f0-70d7abdf289b admin admin] PATH_INFO: `/v3/projects/042d7bea7d4647efb26a862631ac3560/users/b9d202e26dd64cd2acfe23b45ccfd1dd/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.229852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c720f37-5c9e-4a50-a7f0-70d7abdf289b admin admin] RBAC: Authorizing `identity:create_grant(project_id=042d7bea7d4647efb26a862631ac3560, user_id=b9d202e26dd64cd2acfe23b45ccfd1dd, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.242965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c720f37-5c9e-4a50-a7f0-70d7abdf289b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.254903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1106/2218] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:19 2021] PUT /identity/v3/projects/042d7bea7d4647efb26a862631ac3560/users/b9d202e26dd64cd2acfe23b45ccfd1dd/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:19.268429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3959c3b-0f7c-470b-9c02-ecd0da299430 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.268429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3959c3b-0f7c-470b-9c02-ecd0da299430 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.268429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3959c3b-0f7c-470b-9c02-ecd0da299430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.295176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c3959c3b-0f7c-470b-9c02-ecd0da299430 None None] MFA Rules not processed for user `b9d202e26dd64cd2acfe23b45ccfd1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:19.296478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c3959c3b-0f7c-470b-9c02-ecd0da299430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:19.376632 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1113/2219] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:19 2021] POST /identity/v3/auth/tokens => generated 3476 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:19.387225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c720f37-5c9e-4a50-a7f0-70d7abdf289b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.389126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-9c720f37-5c9e-4a50-a7f0-70d7abdf289b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:19.464077 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c720f37-5c9e-4a50-a7f0-70d7abdf289b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.480041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc07048-3cab-4618-853e-c46302d379c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.480694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc07048-3cab-4618-853e-c46302d379c3 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.481009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc07048-3cab-4618-853e-c46302d379c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.481273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc07048-3cab-4618-853e-c46302d379c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.505526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc07048-3cab-4618-853e-c46302d379c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.507847 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc07048-3cab-4618-853e-c46302d379c3 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.530765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1107/2220] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/auth/tokens => generated 3476 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:19.574393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3959c3b-0f7c-470b-9c02-ecd0da299430 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:19.575993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c3959c3b-0f7c-470b-9c02-ecd0da299430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:19.596018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3959c3b-0f7c-470b-9c02-ecd0da299430 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:19.610719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6deebd-6263-4a99-9477-4f0d29203ed4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:19.611384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6deebd-6263-4a99-9477-4f0d29203ed4 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:19.611658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6deebd-6263-4a99-9477-4f0d29203ed4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:19.611927 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6deebd-6263-4a99-9477-4f0d29203ed4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:19.754264 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6deebd-6263-4a99-9477-4f0d29203ed4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:19.755705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6deebd-6263-4a99-9477-4f0d29203ed4 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:19.784249 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1114/2221] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:19 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:25.999954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34416a-c11a-406d-8bd5-ea9c6cd8ad22 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:26.000505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34416a-c11a-406d-8bd5-ea9c6cd8ad22 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:26.000505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34416a-c11a-406d-8bd5-ea9c6cd8ad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:26.018452 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ca34416a-c11a-406d-8bd5-ea9c6cd8ad22 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:26.019645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ca34416a-c11a-406d-8bd5-ea9c6cd8ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:26.079642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1108/2222] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:21:25 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:26.093350 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6deebd-6263-4a99-9477-4f0d29203ed4 service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:26.094816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8c6deebd-6263-4a99-9477-4f0d29203ed4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:26.176132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6deebd-6263-4a99-9477-4f0d29203ed4 service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:26.178735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ea99f6-5974-4ed8-a789-6b2fe6bfcfd5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:26.179397 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea99f6-5974-4ed8-a789-6b2fe6bfcfd5 service swift] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:26.179727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea99f6-5974-4ed8-a789-6b2fe6bfcfd5 service swift] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:26.180003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ea99f6-5974-4ed8-a789-6b2fe6bfcfd5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:26.189405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea99f6-5974-4ed8-a789-6b2fe6bfcfd5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:26.191141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ea99f6-5974-4ed8-a789-6b2fe6bfcfd5 service swift] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:26.203036 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1115/2223] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:21:26 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:21:27.635854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34416a-c11a-406d-8bd5-ea9c6cd8ad22 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:27.737500 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf07c5-008f-4df7-8b65-4ec1bd21fcfc None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.737972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf07c5-008f-4df7-8b65-4ec1bd21fcfc None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.738094 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf07c5-008f-4df7-8b65-4ec1bd21fcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.771774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34416a-c11a-406d-8bd5-ea9c6cd8ad22 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:27.776464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4adf07c5-008f-4df7-8b65-4ec1bd21fcfc None None] MFA Rules not processed for user `d9f2d198479f41a5aede9109c9ae90a9`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:27.777812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:27.778630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4adf07c5-008f-4df7-8b65-4ec1bd21fcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:27.778855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:27.779138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:27.779408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] PATH_INFO: `/v3/users/e4b7565ed5354a9daada7743649edda9` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:27.780797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4b7565ed5354a9daada7743649edda9)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:27.782925 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:27.899270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1116/2224] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:27 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:28.049417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4b7565ed5354a9daada7743649edda9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:28.064003 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4b7565ed5354a9daada7743649edda9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:28.072221 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4b7565ed5354a9daada7743649edda9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:28.073212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4b7565ed5354a9daada7743649edda9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:28.180036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4b7565ed5354a9daada7743649edda9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:28.191514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1109/2225] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:27 2021] DELETE /identity/v3/users/e4b7565ed5354a9daada7743649edda9 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:28.197203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1da2c-4969-46c5-8808-efef821d2f97 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:28.197603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1da2c-4969-46c5-8808-efef821d2f97 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:28.197973 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1da2c-4969-46c5-8808-efef821d2f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:28.273344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-37a1da2c-4969-46c5-8808-efef821d2f97 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:28.289908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-37a1da2c-4969-46c5-8808-efef821d2f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:28.378573 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1117/2226] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:28 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:28.388854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:28.390500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:28.543654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4764b1ef-8419-4616-b583-a9d6d611bc80 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:28.552881 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e2076-475c-415a-8980-940a79737ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:28.553808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2076-475c-415a-8980-940a79737ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:28.554366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2076-475c-415a-8980-940a79737ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:28.554671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e2076-475c-415a-8980-940a79737ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:28.578743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e2076-475c-415a-8980-940a79737ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:28.580196 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e2076-475c-415a-8980-940a79737ef4 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:28.610379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1110/2227] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:28 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:28.755998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1da2c-4969-46c5-8808-efef821d2f97 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:28.758414 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-37a1da2c-4969-46c5-8808-efef821d2f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:28.775669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1da2c-4969-46c5-8808-efef821d2f97 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:28.782585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:28.788279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:28.788279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:28.788279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] PATH_INFO: `/v3/users/aca8e666238c4fc589a03fdc58fa6f6a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:28.788279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aca8e666238c4fc589a03fdc58fa6f6a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:28.788279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:29.026651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aca8e666238c4fc589a03fdc58fa6f6a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:29.051293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aca8e666238c4fc589a03fdc58fa6f6a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:29.068411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aca8e666238c4fc589a03fdc58fa6f6a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:29.178473 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aca8e666238c4fc589a03fdc58fa6f6a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:29.179612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aca8e666238c4fc589a03fdc58fa6f6a'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:29.189921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1118/2228] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:28 2021] DELETE /identity/v3/users/aca8e666238c4fc589a03fdc58fa6f6a => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:29.191474 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93c393-8d3b-4db1-a238-90722d078caf None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:29.191943 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93c393-8d3b-4db1-a238-90722d078caf None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:29.192045 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93c393-8d3b-4db1-a238-90722d078caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:29.233105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-7e93c393-8d3b-4db1-a238-90722d078caf None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:29.234828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-7e93c393-8d3b-4db1-a238-90722d078caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:29.271455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:29.273440 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:29.344354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1111/2229] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:29.354590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93c393-8d3b-4db1-a238-90722d078caf None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:29.356108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-7e93c393-8d3b-4db1-a238-90722d078caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:29.440678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1ac8a-20ae-4a0b-9cba-d89b483a7802 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:29.447945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:29.449215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:29.449497 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:29.449776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] PATH_INFO: `/v3/projects/0223fbffaa7b4c9da7f6f18a3293797f` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:29.451366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0223fbffaa7b4c9da7f6f18a3293797f)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:29.458369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:29.483830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93c393-8d3b-4db1-a238-90722d078caf None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:29.495660 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c959198-2069-4917-9341-ade219246e9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:29.496661 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c959198-2069-4917-9341-ade219246e9d service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:29.497174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c959198-2069-4917-9341-ade219246e9d service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:29.497492 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c959198-2069-4917-9341-ade219246e9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:29.527092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c959198-2069-4917-9341-ade219246e9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:29.528691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c959198-2069-4917-9341-ade219246e9d service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:29.547147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1112/2230] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:21:29.686767 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0223fbffaa7b4c9da7f6f18a3293797f', 'request_id': 'req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:29.708781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0223fbffaa7b4c9da7f6f18a3293797f', 'request_id': 'req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:29.748588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0223fbffaa7b4c9da7f6f18a3293797f', 'request_id': 'req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:30.446641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] The token cache is being invalidate because project 0223fbffaa7b4c9da7f6f18a3293797f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:30.447323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:30.447625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:30.449265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1119/2231] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:29 2021] DELETE /identity/v3/projects/0223fbffaa7b4c9da7f6f18a3293797f => generated 0 bytes in 1178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:21:30.453256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c959198-2069-4917-9341-ade219246e9d service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.463590 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c959198-2069-4917-9341-ade219246e9d service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.518247 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.519102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.519375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.519644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] PATH_INFO: `/v3/users/b9d202e26dd64cd2acfe23b45ccfd1dd` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.520884 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9d202e26dd64cd2acfe23b45ccfd1dd)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.524273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:30.857317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:30.859614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:30.876430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac2f7b-bc85-4c65-b1e7-562e08ac6c98 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:30.882140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:30.883134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:30.883517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:30.884132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] PATH_INFO: `/v3/projects/172b224b354742198a61aaedddefd8ba` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:30.885509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=172b224b354742198a61aaedddefd8ba)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:30.887697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:31.018158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9d202e26dd64cd2acfe23b45ccfd1dd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.031470 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9d202e26dd64cd2acfe23b45ccfd1dd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.039676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9d202e26dd64cd2acfe23b45ccfd1dd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.043097 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9d202e26dd64cd2acfe23b45ccfd1dd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.072119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172b224b354742198a61aaedddefd8ba', 'request_id': 'req-76a1fa38-547c-4646-894a-84100847bd63'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.079483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172b224b354742198a61aaedddefd8ba', 'request_id': 'req-76a1fa38-547c-4646-894a-84100847bd63'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.086738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172b224b354742198a61aaedddefd8ba', 'request_id': 'req-76a1fa38-547c-4646-894a-84100847bd63'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.178555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9d202e26dd64cd2acfe23b45ccfd1dd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.187560 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1113/2232] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:30 2021] DELETE /identity/v3/users/b9d202e26dd64cd2acfe23b45ccfd1dd => generated 0 bytes in 735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:31.259663 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] The token cache is being invalidate because project 172b224b354742198a61aaedddefd8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:31.260188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.260923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-76a1fa38-547c-4646-894a-84100847bd63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:31.268924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1120/2233] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:30 2021] DELETE /identity/v3/projects/172b224b354742198a61aaedddefd8ba => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:31.837205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:31.837205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:31.932686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b64a4-8c12-4951-b6d9-055e75c1be50 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:31.942337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:31.942676 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:31.942775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:31.942994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] PATH_INFO: `/v3/projects/042d7bea7d4647efb26a862631ac3560` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:31.946064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=042d7bea7d4647efb26a862631ac3560)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:31.948135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:32.079435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042d7bea7d4647efb26a862631ac3560', 'request_id': 'req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:32.089269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042d7bea7d4647efb26a862631ac3560', 'request_id': 'req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:32.095913 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042d7bea7d4647efb26a862631ac3560', 'request_id': 'req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:32.172517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] The token cache is being invalidate because project 042d7bea7d4647efb26a862631ac3560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:32.172828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:32.173429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4e983a5f-b61f-4f2a-99a2-a3ab6e0f33e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:32.175296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1114/2234] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:31 2021] DELETE /identity/v3/projects/042d7bea7d4647efb26a862631ac3560 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:32.181843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c4ae2-b5b5-4477-80f7-28df72896c56 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.182415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c4ae2-b5b5-4477-80f7-28df72896c56 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.182642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c4ae2-b5b5-4477-80f7-28df72896c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.226759 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f59c4ae2-b5b5-4477-80f7-28df72896c56 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:32.228196 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f59c4ae2-b5b5-4477-80f7-28df72896c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:32.340254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1121/2235] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:32.349302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da2b2-3082-4279-aa95-e9a1e816e21a None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.349759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da2b2-3082-4279-aa95-e9a1e816e21a None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.350406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140da2b2-3082-4279-aa95-e9a1e816e21a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.370919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-140da2b2-3082-4279-aa95-e9a1e816e21a None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:32.372232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-140da2b2-3082-4279-aa95-e9a1e816e21a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:32.383210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1115/2236] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:32.387922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c4ae2-b5b5-4477-80f7-28df72896c56 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:32.402106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59c4ae2-b5b5-4477-80f7-28df72896c56 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:32.410395 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b39a9a-cfb4-4f52-bc30-c4aa024c6713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:32.411196 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b39a9a-cfb4-4f52-bc30-c4aa024c6713 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.411478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b39a9a-cfb4-4f52-bc30-c4aa024c6713 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.422758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b39a9a-cfb4-4f52-bc30-c4aa024c6713 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.422758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b39a9a-cfb4-4f52-bc30-c4aa024c6713 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:32.422758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b39a9a-cfb4-4f52-bc30-c4aa024c6713 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:32.422758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b39a9a-cfb4-4f52-bc30-c4aa024c6713 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:32.430214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1122/2237] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:21:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:32.434213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140da2b2-3082-4279-aa95-e9a1e816e21a None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:32.445632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140da2b2-3082-4279-aa95-e9a1e816e21a None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:32.450932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca23150-1211-4fb8-a3e1-8facca43337f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:32.451585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca23150-1211-4fb8-a3e1-8facca43337f admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.451877 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca23150-1211-4fb8-a3e1-8facca43337f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.452145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca23150-1211-4fb8-a3e1-8facca43337f admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.452848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca23150-1211-4fb8-a3e1-8facca43337f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:32.454752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca23150-1211-4fb8-a3e1-8facca43337f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:32.788257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1116/2238] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:32 2021] POST /identity/v3/projects => generated 383 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:32.803371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b39a9a-cfb4-4f52-bc30-c4aa024c6713 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:32.816936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b39a9a-cfb4-4f52-bc30-c4aa024c6713 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:32.917744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9105f2-6701-4ed5-9eda-2e074b5a7aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:32.918887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9105f2-6701-4ed5-9eda-2e074b5a7aae admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:32.919387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9105f2-6701-4ed5-9eda-2e074b5a7aae admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:32.919755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9105f2-6701-4ed5-9eda-2e074b5a7aae admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:32.920608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9105f2-6701-4ed5-9eda-2e074b5a7aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:32.922598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9105f2-6701-4ed5-9eda-2e074b5a7aae admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.030881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1123/2239] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:21:32 2021] POST /identity/v3/users => generated 292 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:33.034923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca23150-1211-4fb8-a3e1-8facca43337f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.052259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca23150-1211-4fb8-a3e1-8facca43337f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.062760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6ce36-a811-4408-9968-1394e5c38afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.064256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6ce36-a811-4408-9968-1394e5c38afc admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.064946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6ce36-a811-4408-9968-1394e5c38afc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.066298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe6ce36-a811-4408-9968-1394e5c38afc admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.068592 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6ce36-a811-4408-9968-1394e5c38afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.074333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe6ce36-a811-4408-9968-1394e5c38afc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.093121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1117/2240] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:33.096785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9105f2-6701-4ed5-9eda-2e074b5a7aae admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.110102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9105f2-6701-4ed5-9eda-2e074b5a7aae admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.115237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66eb60e-7f3d-460f-b5e3-1d0a5940f4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.116999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eb60e-7f3d-460f-b5e3-1d0a5940f4fa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.117382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eb60e-7f3d-460f-b5e3-1d0a5940f4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.117749 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66eb60e-7f3d-460f-b5e3-1d0a5940f4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.118692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eb60e-7f3d-460f-b5e3-1d0a5940f4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.121541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66eb60e-7f3d-460f-b5e3-1d0a5940f4fa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.158949 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1124/2241] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:33 2021] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:33.165865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6ce36-a811-4408-9968-1394e5c38afc admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.185908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe6ce36-a811-4408-9968-1394e5c38afc admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.204917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65bc5-a93b-4395-b12f-bd520f5f932c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.206307 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65bc5-a93b-4395-b12f-bd520f5f932c admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.206738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65bc5-a93b-4395-b12f-bd520f5f932c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.207137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb65bc5-a93b-4395-b12f-bd520f5f932c admin admin] PATH_INFO: `/v3/projects/2d8d36480ab84442a32433b979a21ba1/users/4318e0d7eb784af38ae088eed644b6d4/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.243025 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65bc5-a93b-4395-b12f-bd520f5f932c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d8d36480ab84442a32433b979a21ba1, user_id=4318e0d7eb784af38ae088eed644b6d4, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.246017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb65bc5-a93b-4395-b12f-bd520f5f932c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.412837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1118/2242] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:33 2021] PUT /identity/v3/projects/2d8d36480ab84442a32433b979a21ba1/users/4318e0d7eb784af38ae088eed644b6d4/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:33.424475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e35d-5534-43dc-a434-0c3ae68d3013 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.425011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e35d-5534-43dc-a434-0c3ae68d3013 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.425011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599e35d-5534-43dc-a434-0c3ae68d3013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.456229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f599e35d-5534-43dc-a434-0c3ae68d3013 None None] MFA Rules not processed for user `4318e0d7eb784af38ae088eed644b6d4`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:33.457740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f599e35d-5534-43dc-a434-0c3ae68d3013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:33.528106 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1125/2243] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:33 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:33.532964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65bc5-a93b-4395-b12f-bd520f5f932c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.610104 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb65bc5-a93b-4395-b12f-bd520f5f932c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.614876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b355-f769-42db-a85b-a961ba49242a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.615560 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b355-f769-42db-a85b-a961ba49242a admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.615834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b355-f769-42db-a85b-a961ba49242a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.616102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10b355-f769-42db-a85b-a961ba49242a admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.616807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10b355-f769-42db-a85b-a961ba49242a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.635603 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f10b355-f769-42db-a85b-a961ba49242a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:33.803731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1119/2244] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:33 2021] POST /identity/v3/projects => generated 381 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:33.804129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599e35d-5534-43dc-a434-0c3ae68d3013 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:33.815497 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599e35d-5534-43dc-a434-0c3ae68d3013 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:33.923187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27f73-d5ff-4a4a-b87f-0fd65d13562d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:33.923872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27f73-d5ff-4a4a-b87f-0fd65d13562d admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:33.924150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27f73-d5ff-4a4a-b87f-0fd65d13562d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:33.924422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27f73-d5ff-4a4a-b87f-0fd65d13562d admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:33.925169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b27f73-d5ff-4a4a-b87f-0fd65d13562d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:33.927188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b27f73-d5ff-4a4a-b87f-0fd65d13562d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:34.445515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1126/2245] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:21:33 2021] POST /identity/v3/users => generated 297 bytes in 647 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:34.449696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b355-f769-42db-a85b-a961ba49242a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:34.460079 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10b355-f769-42db-a85b-a961ba49242a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:34.464819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4e2b-d2cf-47cb-9c03-cdfa60b6f770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:34.465695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4e2b-d2cf-47cb-9c03-cdfa60b6f770 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:34.465946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4e2b-d2cf-47cb-9c03-cdfa60b6f770 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:34.466266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74d4e2b-d2cf-47cb-9c03-cdfa60b6f770 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:34.467032 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d4e2b-d2cf-47cb-9c03-cdfa60b6f770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:34.468603 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74d4e2b-d2cf-47cb-9c03-cdfa60b6f770 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:34.480482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1120/2246] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:34 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:34.485049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27f73-d5ff-4a4a-b87f-0fd65d13562d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:34.503565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27f73-d5ff-4a4a-b87f-0fd65d13562d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:34.509296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f729097-d760-4523-afc4-eeb8ed2b9817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:34.510246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f729097-d760-4523-afc4-eeb8ed2b9817 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:34.510691 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f729097-d760-4523-afc4-eeb8ed2b9817 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:34.510963 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f729097-d760-4523-afc4-eeb8ed2b9817 admin admin] PATH_INFO: `/v3/projects/a117d383d2a747bf9bfb02423bb74387/users/c0f6f0391cb94e51b4d46fdc067e21e1/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:34.529266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f729097-d760-4523-afc4-eeb8ed2b9817 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a117d383d2a747bf9bfb02423bb74387, user_id=c0f6f0391cb94e51b4d46fdc067e21e1, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:34.532130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f729097-d760-4523-afc4-eeb8ed2b9817 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:34.648719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1127/2247] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:34 2021] PUT /identity/v3/projects/a117d383d2a747bf9bfb02423bb74387/users/c0f6f0391cb94e51b4d46fdc067e21e1/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:34.653934 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4e2b-d2cf-47cb-9c03-cdfa60b6f770 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:34.667597 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74d4e2b-d2cf-47cb-9c03-cdfa60b6f770 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:34.739658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86893b75-0c33-4e7a-b07d-af4196037ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:34.740628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86893b75-0c33-4e7a-b07d-af4196037ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:34.741121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86893b75-0c33-4e7a-b07d-af4196037ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:34.741500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86893b75-0c33-4e7a-b07d-af4196037ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:34.742481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86893b75-0c33-4e7a-b07d-af4196037ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:34.744655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86893b75-0c33-4e7a-b07d-af4196037ee8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:34.760458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1121/2248] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:34 2021] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:34.762991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f729097-d760-4523-afc4-eeb8ed2b9817 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:34.776226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f729097-d760-4523-afc4-eeb8ed2b9817 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:34.796406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247d072-0db8-49b3-a0c6-3e8d3221e8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:34.800293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247d072-0db8-49b3-a0c6-3e8d3221e8a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:34.800731 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247d072-0db8-49b3-a0c6-3e8d3221e8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:34.802647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d247d072-0db8-49b3-a0c6-3e8d3221e8a5 admin admin] PATH_INFO: `/v3/projects/a117d383d2a747bf9bfb02423bb74387/users/c0f6f0391cb94e51b4d46fdc067e21e1/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:34.807618 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247d072-0db8-49b3-a0c6-3e8d3221e8a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a117d383d2a747bf9bfb02423bb74387, user_id=c0f6f0391cb94e51b4d46fdc067e21e1, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:34.810870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d247d072-0db8-49b3-a0c6-3e8d3221e8a5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:34.833688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1128/2249] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:34 2021] PUT /identity/v3/projects/a117d383d2a747bf9bfb02423bb74387/users/c0f6f0391cb94e51b4d46fdc067e21e1/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:21:34.837446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35093307-864b-40b8-88c4-1ed600776625 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:34.838772 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35093307-864b-40b8-88c4-1ed600776625 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:34.839807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35093307-864b-40b8-88c4-1ed600776625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:34.890741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-35093307-864b-40b8-88c4-1ed600776625 None None] MFA Rules not processed for user `c0f6f0391cb94e51b4d46fdc067e21e1`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:34.892388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-35093307-864b-40b8-88c4-1ed600776625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:35.026191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1122/2250] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:34 2021] POST /identity/v3/auth/tokens => generated 3468 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:35.034355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247d072-0db8-49b3-a0c6-3e8d3221e8a5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:35.036075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d247d072-0db8-49b3-a0c6-3e8d3221e8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:35.171885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d247d072-0db8-49b3-a0c6-3e8d3221e8a5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:35.186685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e7c7-f95b-479d-83d3-932c4217a527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:35.187357 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e7c7-f95b-479d-83d3-932c4217a527 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.187634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e7c7-f95b-479d-83d3-932c4217a527 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.187903 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9e7c7-f95b-479d-83d3-932c4217a527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.189090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05200d-2592-4cd4-b321-1779f22ab0ca None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.189716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05200d-2592-4cd4-b321-1779f22ab0ca None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.190958 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05200d-2592-4cd4-b321-1779f22ab0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.220782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9e7c7-f95b-479d-83d3-932c4217a527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:35.222617 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9e7c7-f95b-479d-83d3-932c4217a527 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:35.236572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-cf05200d-2592-4cd4-b321-1779f22ab0ca None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:35.238253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-cf05200d-2592-4cd4-b321-1779f22ab0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:35.258941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1129/2251] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:35 2021] GET /identity/v3/auth/tokens => generated 3468 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:35.399792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1123/2252] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:21:35 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:35.419572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e7c7-f95b-479d-83d3-932c4217a527 service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:35.420986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e7c9e7c7-f95b-479d-83d3-932c4217a527 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:35.471536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05200d-2592-4cd4-b321-1779f22ab0ca None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:35.491346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05200d-2592-4cd4-b321-1779f22ab0ca None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:35.505166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36090855-c077-40e3-9b6f-b8fe8d2c278a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:35.509186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36090855-c077-40e3-9b6f-b8fe8d2c278a service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.509468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36090855-c077-40e3-9b6f-b8fe8d2c278a service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.509738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36090855-c077-40e3-9b6f-b8fe8d2c278a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.624844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36090855-c077-40e3-9b6f-b8fe8d2c278a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:35.626298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36090855-c077-40e3-9b6f-b8fe8d2c278a service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:35.637040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1124/2253] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:35 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:21:35.644901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9e7c7-f95b-479d-83d3-932c4217a527 service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:35.670718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c87c4-53c1-4f99-8302-8def6ebbcea2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:35.671400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c87c4-53c1-4f99-8302-8def6ebbcea2 service swift] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:35.671677 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c87c4-53c1-4f99-8302-8def6ebbcea2 service swift] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:35.672113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c87c4-53c1-4f99-8302-8def6ebbcea2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:35.693441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c87c4-53c1-4f99-8302-8def6ebbcea2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:35.698335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c87c4-53c1-4f99-8302-8def6ebbcea2 service swift] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:35.753254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1130/2254] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:21:35 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:21:36.416913 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36090855-c077-40e3-9b6f-b8fe8d2c278a service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:36.534064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36090855-c077-40e3-9b6f-b8fe8d2c278a service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:36.543452 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:36.544521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.545117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.545860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] PATH_INFO: `/v3/users/4318e0d7eb784af38ae088eed644b6d4` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:36.547392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4318e0d7eb784af38ae088eed644b6d4)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:36.553673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:36.767340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4318e0d7eb784af38ae088eed644b6d4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:36.821349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4318e0d7eb784af38ae088eed644b6d4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:36.869900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4318e0d7eb784af38ae088eed644b6d4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:36.874586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4318e0d7eb784af38ae088eed644b6d4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:36.976634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4318e0d7eb784af38ae088eed644b6d4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:36.986282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1125/2255] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:36 2021] DELETE /identity/v3/users/4318e0d7eb784af38ae088eed644b6d4 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:36.992812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7494b-60e5-41f3-8087-81358414b30f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:36.993381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7494b-60e5-41f3-8087-81358414b30f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:36.993381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e7494b-60e5-41f3-8087-81358414b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:37.026728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-30e7494b-60e5-41f3-8087-81358414b30f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:37.028595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-30e7494b-60e5-41f3-8087-81358414b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:37.175961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1131/2256] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:37.217874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:37.220932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:37.488166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8e2dc-8a2d-4f7c-b8dd-dc0090f34776 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:37.493563 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bdd02-c2a3-4cbd-8793-9d435ba843aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:37.494731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bdd02-c2a3-4cbd-8793-9d435ba843aa service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:37.495344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bdd02-c2a3-4cbd-8793-9d435ba843aa service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:37.495762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bdd02-c2a3-4cbd-8793-9d435ba843aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:37.517661 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bdd02-c2a3-4cbd-8793-9d435ba843aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:37.519417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07bdd02-c2a3-4cbd-8793-9d435ba843aa service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:37.542632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1126/2257] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:37 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:38.393027 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7494b-60e5-41f3-8087-81358414b30f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:38.395038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-30e7494b-60e5-41f3-8087-81358414b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:38.422257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e7494b-60e5-41f3-8087-81358414b30f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:38.437571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:38.438000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:38.438000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:38.438165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] PATH_INFO: `/v3/projects/2d8d36480ab84442a32433b979a21ba1` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:38.441900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d8d36480ab84442a32433b979a21ba1)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:38.444038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:38.700936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d8d36480ab84442a32433b979a21ba1', 'request_id': 'req-fc00e1bb-6db6-4001-bbbd-7af96be94a53'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:38.724255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d8d36480ab84442a32433b979a21ba1', 'request_id': 'req-fc00e1bb-6db6-4001-bbbd-7af96be94a53'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:38.756719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d8d36480ab84442a32433b979a21ba1', 'request_id': 'req-fc00e1bb-6db6-4001-bbbd-7af96be94a53'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:39.841152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] The token cache is being invalidate because project 2d8d36480ab84442a32433b979a21ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:39.841936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:39.842111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:39.844619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1132/2258] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:38 2021] DELETE /identity/v3/projects/2d8d36480ab84442a32433b979a21ba1 => generated 0 bytes in 1452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:39.848910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bdd02-c2a3-4cbd-8793-9d435ba843aa service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:39.870687 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bdd02-c2a3-4cbd-8793-9d435ba843aa service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:39.946349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:39.947212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:39.947482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:39.947808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] PATH_INFO: `/v3/users/c0f6f0391cb94e51b4d46fdc067e21e1` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:39.948999 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0f6f0391cb94e51b4d46fdc067e21e1)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:39.951056 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:40.175130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0f6f0391cb94e51b4d46fdc067e21e1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:40.189601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0f6f0391cb94e51b4d46fdc067e21e1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:40.201212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0f6f0391cb94e51b4d46fdc067e21e1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:40.202209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0f6f0391cb94e51b4d46fdc067e21e1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:40.296992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-0f66f1cb-caaf-4a5b-97e8-fd9c9239b491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0f6f0391cb94e51b4d46fdc067e21e1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:40.307712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1127/2259] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:39 2021] DELETE /identity/v3/users/c0f6f0391cb94e51b4d46fdc067e21e1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:40.807546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:40.809117 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:40.823042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc00e1bb-6db6-4001-bbbd-7af96be94a53 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:40.890860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:40.891717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:40.891994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:40.892269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] PATH_INFO: `/v3/projects/a117d383d2a747bf9bfb02423bb74387` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:40.893481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=a117d383d2a747bf9bfb02423bb74387)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:40.895405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:41.044896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a117d383d2a747bf9bfb02423bb74387', 'request_id': 'req-bad1b002-2cb1-417e-8335-54c13ebcbfdd'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:41.055394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a117d383d2a747bf9bfb02423bb74387', 'request_id': 'req-bad1b002-2cb1-417e-8335-54c13ebcbfdd'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:41.056953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a117d383d2a747bf9bfb02423bb74387', 'request_id': 'req-bad1b002-2cb1-417e-8335-54c13ebcbfdd'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:41.138375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] The token cache is being invalidate because project a117d383d2a747bf9bfb02423bb74387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:41.138706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:41.139453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bad1b002-2cb1-417e-8335-54c13ebcbfdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:41.141198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1133/2260] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:40 2021] DELETE /identity/v3/projects/a117d383d2a747bf9bfb02423bb74387 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:41.147732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace088a7-d88f-4936-9cd9-9df1d9d20369 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:41.147732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace088a7-d88f-4936-9cd9-9df1d9d20369 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:41.148333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace088a7-d88f-4936-9cd9-9df1d9d20369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:41.186137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ace088a7-d88f-4936-9cd9-9df1d9d20369 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:41.187741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ace088a7-d88f-4936-9cd9-9df1d9d20369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:41.262062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1128/2261] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:21:41.270167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67ab2-ba2e-4320-b400-b17abd8f7a99 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:41.270385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67ab2-ba2e-4320-b400-b17abd8f7a99 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:41.270671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67ab2-ba2e-4320-b400-b17abd8f7a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:41.294704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-a3a67ab2-ba2e-4320-b400-b17abd8f7a99 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:41.296432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a3a67ab2-ba2e-4320-b400-b17abd8f7a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:41.309998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1134/2262] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:41 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:41.311443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace088a7-d88f-4936-9cd9-9df1d9d20369 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:41.321450 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace088a7-d88f-4936-9cd9-9df1d9d20369 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:41.326386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f8ebf-ebb0-408e-bd24-d382afa6f02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:41.327052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8ebf-ebb0-408e-bd24-d382afa6f02f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:41.327335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8ebf-ebb0-408e-bd24-d382afa6f02f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:41.327635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43f8ebf-ebb0-408e-bd24-d382afa6f02f admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:41.328368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f8ebf-ebb0-408e-bd24-d382afa6f02f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:41.328841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f8ebf-ebb0-408e-bd24-d382afa6f02f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:41.330462 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43f8ebf-ebb0-408e-bd24-d382afa6f02f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:41.348806 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1129/2263] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:21:41 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:21:41.349761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a67ab2-ba2e-4320-b400-b17abd8f7a99 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:41.362517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a67ab2-ba2e-4320-b400-b17abd8f7a99 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:41.368148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324b745-a4d3-40d1-b1dd-8c29ec53675c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:41.368895 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324b745-a4d3-40d1-b1dd-8c29ec53675c admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:41.369236 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324b745-a4d3-40d1-b1dd-8c29ec53675c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:41.369577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d324b745-a4d3-40d1-b1dd-8c29ec53675c admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:41.370461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324b745-a4d3-40d1-b1dd-8c29ec53675c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:41.372520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d324b745-a4d3-40d1-b1dd-8c29ec53675c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:41.470060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1135/2264] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:41 2021] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:41.473145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f8ebf-ebb0-408e-bd24-d382afa6f02f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:41.483832 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43f8ebf-ebb0-408e-bd24-d382afa6f02f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:41.538147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29577c4-6bb5-4d81-abd9-7492475f8ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:41.538809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29577c4-6bb5-4d81-abd9-7492475f8ecc admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:41.539083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29577c4-6bb5-4d81-abd9-7492475f8ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:41.539368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29577c4-6bb5-4d81-abd9-7492475f8ecc admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:41.540031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29577c4-6bb5-4d81-abd9-7492475f8ecc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:41.541927 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29577c4-6bb5-4d81-abd9-7492475f8ecc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:41.664961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1130/2265] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:21:41 2021] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:21:41.669079 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324b745-a4d3-40d1-b1dd-8c29ec53675c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:41.679170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d324b745-a4d3-40d1-b1dd-8c29ec53675c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:41.683710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68472b5-2452-4f1f-8052-651b5e9da3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:41.684354 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68472b5-2452-4f1f-8052-651b5e9da3ce admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:41.684667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68472b5-2452-4f1f-8052-651b5e9da3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:41.684905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68472b5-2452-4f1f-8052-651b5e9da3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:41.685624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68472b5-2452-4f1f-8052-651b5e9da3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:41.687261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68472b5-2452-4f1f-8052-651b5e9da3ce admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:41.698207 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1136/2266] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:41 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:41.702242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29577c4-6bb5-4d81-abd9-7492475f8ecc admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:41.713005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29577c4-6bb5-4d81-abd9-7492475f8ecc admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:41.717701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751eab-71bf-43c0-8236-088dd62bdea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:41.718390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751eab-71bf-43c0-8236-088dd62bdea7 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:41.719144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751eab-71bf-43c0-8236-088dd62bdea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:41.719144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751eab-71bf-43c0-8236-088dd62bdea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:41.719868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751eab-71bf-43c0-8236-088dd62bdea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:41.721431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751eab-71bf-43c0-8236-088dd62bdea7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:41.732260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1131/2267] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:41 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:41.736408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68472b5-2452-4f1f-8052-651b5e9da3ce admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:41.746593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68472b5-2452-4f1f-8052-651b5e9da3ce admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:41.751364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ed3a5-7c93-46bf-b12c-84b91b0df35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:41.752231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ed3a5-7c93-46bf-b12c-84b91b0df35f admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:41.752514 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ed3a5-7c93-46bf-b12c-84b91b0df35f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:41.752789 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228ed3a5-7c93-46bf-b12c-84b91b0df35f admin admin] PATH_INFO: `/v3/projects/cb304d84cca84829a927f7602f1eb969/users/2a3a4f2d2d5b45508139a28712bc691e/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:41.768014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ed3a5-7c93-46bf-b12c-84b91b0df35f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb304d84cca84829a927f7602f1eb969, user_id=2a3a4f2d2d5b45508139a28712bc691e, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:41.771536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228ed3a5-7c93-46bf-b12c-84b91b0df35f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:41.847231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1137/2268] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:41 2021] PUT /identity/v3/projects/cb304d84cca84829a927f7602f1eb969/users/2a3a4f2d2d5b45508139a28712bc691e/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:41.858773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d62d-68bd-4a8c-b8fe-aac03e7a2507 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:41.859069 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d62d-68bd-4a8c-b8fe-aac03e7a2507 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:41.859320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329d62d-68bd-4a8c-b8fe-aac03e7a2507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:41.888903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8329d62d-68bd-4a8c-b8fe-aac03e7a2507 None None] MFA Rules not processed for user `2a3a4f2d2d5b45508139a28712bc691e`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:41.889968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8329d62d-68bd-4a8c-b8fe-aac03e7a2507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:41.957388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1132/2269] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:41 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:41.968316 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ed3a5-7c93-46bf-b12c-84b91b0df35f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:41.971039 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-228ed3a5-7c93-46bf-b12c-84b91b0df35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:42.039526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228ed3a5-7c93-46bf-b12c-84b91b0df35f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:42.043333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0c605-8bdd-4438-b385-84ef795c4b5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:42.044043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c605-8bdd-4438-b385-84ef795c4b5a service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:42.044385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c605-8bdd-4438-b385-84ef795c4b5a service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:42.044722 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0c605-8bdd-4438-b385-84ef795c4b5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:42.053418 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0c605-8bdd-4438-b385-84ef795c4b5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:42.054988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0c605-8bdd-4438-b385-84ef795c4b5a service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:42.064271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1138/2270] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:41 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:51.182008 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d62d-68bd-4a8c-b8fe-aac03e7a2507 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:51.183541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8329d62d-68bd-4a8c-b8fe-aac03e7a2507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:51.245882 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329d62d-68bd-4a8c-b8fe-aac03e7a2507 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:51.250506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:51.251356 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:51.251631 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:51.251902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] PATH_INFO: `/v3/users/725e3f97cb1c403e896947c997fd351a` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:51.253092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=725e3f97cb1c403e896947c997fd351a)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:51.255018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:51.470017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '725e3f97cb1c403e896947c997fd351a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:51.482813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '725e3f97cb1c403e896947c997fd351a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:51.489510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '725e3f97cb1c403e896947c997fd351a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:51.490376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '725e3f97cb1c403e896947c997fd351a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:51.564612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '725e3f97cb1c403e896947c997fd351a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:51.570719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1133/2271] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:21:51 2021] DELETE /identity/v3/users/725e3f97cb1c403e896947c997fd351a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:51.575147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09f740-2a6e-4ebc-a8b3-124c8bb8b8b2 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:51.575688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09f740-2a6e-4ebc-a8b3-124c8bb8b8b2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:51.575796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09f740-2a6e-4ebc-a8b3-124c8bb8b8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:51.592289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-7f09f740-2a6e-4ebc-a8b3-124c8bb8b8b2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:51.593462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7f09f740-2a6e-4ebc-a8b3-124c8bb8b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:51.650180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1139/2272] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:51 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:51.660267 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:51.661800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:51.719135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1109dd12-8376-4582-8736-c86485fd1e0f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:51.722796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b441a5-7f0b-4b27-b304-4347fc856108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:51.723443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b441a5-7f0b-4b27-b304-4347fc856108 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:51.723720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b441a5-7f0b-4b27-b304-4347fc856108 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:51.723981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b441a5-7f0b-4b27-b304-4347fc856108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:51.734556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b441a5-7f0b-4b27-b304-4347fc856108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:51.735997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b441a5-7f0b-4b27-b304-4347fc856108 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:51.746850 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1134/2273] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:51 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:21:52.161036 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09f740-2a6e-4ebc-a8b3-124c8bb8b8b2 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:52.163060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7f09f740-2a6e-4ebc-a8b3-124c8bb8b8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:52.175867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09f740-2a6e-4ebc-a8b3-124c8bb8b8b2 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:52.181417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:52.182330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.182612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.182884 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] PATH_INFO: `/v3/projects/f35b38b27bcf44979bfa4b763eef135c` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.184747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35b38b27bcf44979bfa4b763eef135c)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:52.186715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:52.296506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35b38b27bcf44979bfa4b763eef135c', 'request_id': 'req-d49dff9d-95fc-448b-8389-d0330152dfdc'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:52.303535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35b38b27bcf44979bfa4b763eef135c', 'request_id': 'req-d49dff9d-95fc-448b-8389-d0330152dfdc'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:52.310793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35b38b27bcf44979bfa4b763eef135c', 'request_id': 'req-d49dff9d-95fc-448b-8389-d0330152dfdc'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:52.386542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] The token cache is being invalidate because project f35b38b27bcf44979bfa4b763eef135c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:21:52.386825 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:52.387460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d49dff9d-95fc-448b-8389-d0330152dfdc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:21:52.388959 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1140/2274] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:21:52 2021] DELETE /identity/v3/projects/f35b38b27bcf44979bfa4b763eef135c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:52.394671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b8aee-e770-470a-b3ec-75b87117ddf3 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.395150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b8aee-e770-470a-b3ec-75b87117ddf3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.395242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b8aee-e770-470a-b3ec-75b87117ddf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.423129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-454b8aee-e770-470a-b3ec-75b87117ddf3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:52.424220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-454b8aee-e770-470a-b3ec-75b87117ddf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:52.479838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1135/2275] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:52.488477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83865d15-6a1e-444c-977d-4846bcc4aa1d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.494575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83865d15-6a1e-444c-977d-4846bcc4aa1d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.494575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83865d15-6a1e-444c-977d-4846bcc4aa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.508036 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-83865d15-6a1e-444c-977d-4846bcc4aa1d None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:52.509229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-83865d15-6a1e-444c-977d-4846bcc4aa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:52.517011 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1141/2276] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:52 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:52.522363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b8aee-e770-470a-b3ec-75b87117ddf3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:52.532100 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b8aee-e770-470a-b3ec-75b87117ddf3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:52.537658 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa4ecc-cd21-4089-9eb0-4eb8fc909a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:52.538411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4ecc-cd21-4089-9eb0-4eb8fc909a35 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.538693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4ecc-cd21-4089-9eb0-4eb8fc909a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.538998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaa4ecc-cd21-4089-9eb0-4eb8fc909a35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.539732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa4ecc-cd21-4089-9eb0-4eb8fc909a35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:21:52.540032 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa4ecc-cd21-4089-9eb0-4eb8fc909a35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:52.541586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaa4ecc-cd21-4089-9eb0-4eb8fc909a35 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:52.553357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1136/2277] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:21:52 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:21:52.558197 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83865d15-6a1e-444c-977d-4846bcc4aa1d None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:52.566564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83865d15-6a1e-444c-977d-4846bcc4aa1d None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:52.571564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe13bd-fe5e-4b86-a548-cefb0f5775eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:52.572213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe13bd-fe5e-4b86-a548-cefb0f5775eb admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.572491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe13bd-fe5e-4b86-a548-cefb0f5775eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.572763 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbe13bd-fe5e-4b86-a548-cefb0f5775eb admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.573460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe13bd-fe5e-4b86-a548-cefb0f5775eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:52.575364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbe13bd-fe5e-4b86-a548-cefb0f5775eb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:52.655387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1142/2278] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:21:52 2021] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:52.658321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa4ecc-cd21-4089-9eb0-4eb8fc909a35 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:52.669562 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaa4ecc-cd21-4089-9eb0-4eb8fc909a35 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:52.728291 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4f714-a513-41eb-a8f7-9ab84d82a68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:52.728867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f714-a513-41eb-a8f7-9ab84d82a68b admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.729144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f714-a513-41eb-a8f7-9ab84d82a68b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.729414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa4f714-a513-41eb-a8f7-9ab84d82a68b admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.730144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4f714-a513-41eb-a8f7-9ab84d82a68b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:52.732286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa4f714-a513-41eb-a8f7-9ab84d82a68b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:52.861883 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1137/2279] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:21:52 2021] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:21:52.863209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe13bd-fe5e-4b86-a548-cefb0f5775eb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:52.873428 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbe13bd-fe5e-4b86-a548-cefb0f5775eb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:52.878315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e9b83-dd07-45fc-af7b-0765eb1968a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:52.878976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9b83-dd07-45fc-af7b-0765eb1968a7 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.879252 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9b83-dd07-45fc-af7b-0765eb1968a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.879528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e9b83-dd07-45fc-af7b-0765eb1968a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.880256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e9b83-dd07-45fc-af7b-0765eb1968a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:52.881981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e9b83-dd07-45fc-af7b-0765eb1968a7 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:52.893014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1143/2280] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:52 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:21:52.898064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4f714-a513-41eb-a8f7-9ab84d82a68b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:52.907994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa4f714-a513-41eb-a8f7-9ab84d82a68b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:52.913380 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696bb4f0-fe7f-4f74-946f-96efe4f2de4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:52.914072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bb4f0-fe7f-4f74-946f-96efe4f2de4a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.914357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bb4f0-fe7f-4f74-946f-96efe4f2de4a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.914633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696bb4f0-fe7f-4f74-946f-96efe4f2de4a admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.915374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bb4f0-fe7f-4f74-946f-96efe4f2de4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:52.917055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696bb4f0-fe7f-4f74-946f-96efe4f2de4a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:52.927160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1138/2281] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:21:52 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:21:52.931270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e9b83-dd07-45fc-af7b-0765eb1968a7 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:52.940897 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e9b83-dd07-45fc-af7b-0765eb1968a7 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:52.946270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02a338-8d5d-4319-913a-f9f0ee424722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:52.947144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02a338-8d5d-4319-913a-f9f0ee424722 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:52.947425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02a338-8d5d-4319-913a-f9f0ee424722 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:52.947699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02a338-8d5d-4319-913a-f9f0ee424722 admin admin] PATH_INFO: `/v3/projects/d6922c938c364681b1009bd774cb1ebf/users/7093c2d62dd84ea08abdec091d658d51/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:52.962659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02a338-8d5d-4319-913a-f9f0ee424722 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6922c938c364681b1009bd774cb1ebf, user_id=7093c2d62dd84ea08abdec091d658d51, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:52.965281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a02a338-8d5d-4319-913a-f9f0ee424722 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:53.067107 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1144/2282] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:21:52 2021] PUT /identity/v3/projects/d6922c938c364681b1009bd774cb1ebf/users/7093c2d62dd84ea08abdec091d658d51/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:21:53.077358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b51e5-f514-4c39-834a-b551ee364e0f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:53.077634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b51e5-f514-4c39-834a-b551ee364e0f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:53.079645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6b51e5-f514-4c39-834a-b551ee364e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:53.104647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-be6b51e5-f514-4c39-834a-b551ee364e0f None None] MFA Rules not processed for user `7093c2d62dd84ea08abdec091d658d51`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:21:53.105843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-be6b51e5-f514-4c39-834a-b551ee364e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:53.169204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1139/2283] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:21:53 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:21:53.180156 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02a338-8d5d-4319-913a-f9f0ee424722 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:21:53.181861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9a02a338-8d5d-4319-913a-f9f0ee424722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:21:53.236770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02a338-8d5d-4319-913a-f9f0ee424722 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:21:53.241167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029bdef-36fe-42e1-ad5b-01f511cbff77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:21:53.241792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029bdef-36fe-42e1-ad5b-01f511cbff77 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:21:53.242102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029bdef-36fe-42e1-ad5b-01f511cbff77 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:21:53.242373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029bdef-36fe-42e1-ad5b-01f511cbff77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:21:53.250476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029bdef-36fe-42e1-ad5b-01f511cbff77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:21:53.251921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029bdef-36fe-42e1-ad5b-01f511cbff77 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:21:53.260958 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1145/2284] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:21:53 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:01.167346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd0906-1757-4180-a0e1-cbf12a8ab543 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:01.167969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd0906-1757-4180-a0e1-cbf12a8ab543 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:01.167969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd0906-1757-4180-a0e1-cbf12a8ab543 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:01.169636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1140/2285] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:22:01 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 27 01:22:01.175544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ce67-42af-4331-b6e1-dd9b023d682c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:01.176004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ce67-42af-4331-b6e1-dd9b023d682c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:01.176101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad0ce67-42af-4331-b6e1-dd9b023d682c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:01.234933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-aad0ce67-42af-4331-b6e1-dd9b023d682c None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:01.236135 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-aad0ce67-42af-4331-b6e1-dd9b023d682c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:01.316019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1146/2286] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:22:01 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:01.329103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd0906-1757-4180-a0e1-cbf12a8ab543 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:01.330813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-7bbd0906-1757-4180-a0e1-cbf12a8ab543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:01.386548 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd0906-1757-4180-a0e1-cbf12a8ab543 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:01.390287 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9956613-fa20-474f-81b7-61aaae086c75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f402e17093e4e99afda5ea019f335eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:01.391347 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956613-fa20-474f-81b7-61aaae086c75 service glance] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:01.391843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956613-fa20-474f-81b7-61aaae086c75 service glance] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:01.392335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9956613-fa20-474f-81b7-61aaae086c75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:01.403709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9956613-fa20-474f-81b7-61aaae086c75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:01.405103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9956613-fa20-474f-81b7-61aaae086c75 service glance] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:01.416785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1141/2287] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:01 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:22:01.620239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10619e86-f593-4dda-a442-826e9f9de80c None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:01.620518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10619e86-f593-4dda-a442-826e9f9de80c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:01.620787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10619e86-f593-4dda-a442-826e9f9de80c None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:01.622669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1147/2288] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:22:01 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:01.627640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac5967-117f-4576-8a10-cf7adabde767 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:01.628048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac5967-117f-4576-8a10-cf7adabde767 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:01.628395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ac5967-117f-4576-8a10-cf7adabde767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:01.647630 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-81ac5967-117f-4576-8a10-cf7adabde767 None None] MFA Rules not processed for user `66c74b04afed4aabbdbee054438a4933`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:01.648828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-81ac5967-117f-4576-8a10-cf7adabde767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:01.701765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1142/2289] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:22:01 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:01.716640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10619e86-f593-4dda-a442-826e9f9de80c None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:01.722143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-10619e86-f593-4dda-a442-826e9f9de80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:01.735716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10619e86-f593-4dda-a442-826e9f9de80c None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:01.739451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5303eb-0be9-465a-a54b-1d8e114a3b55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:01.748001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5303eb-0be9-465a-a54b-1d8e114a3b55 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:01.748001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5303eb-0be9-465a-a54b-1d8e114a3b55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:01.748001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5303eb-0be9-465a-a54b-1d8e114a3b55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:01.749209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5303eb-0be9-465a-a54b-1d8e114a3b55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:01.750764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5303eb-0be9-465a-a54b-1d8e114a3b55 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:01.758627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1148/2290] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:22:09.438760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dec59-3d58-4fad-a76a-f6f3d50c6ad6 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:09.439245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dec59-3d58-4fad-a76a-f6f3d50c6ad6 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:09.439351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dec59-3d58-4fad-a76a-f6f3d50c6ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:09.461125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-565dec59-3d58-4fad-a76a-f6f3d50c6ad6 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:09.461125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-565dec59-3d58-4fad-a76a-f6f3d50c6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:09.518637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1143/2291] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:22:09 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:09.533387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5303eb-0be9-465a-a54b-1d8e114a3b55 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:09.534796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4b5303eb-0be9-465a-a54b-1d8e114a3b55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:09.601597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5303eb-0be9-465a-a54b-1d8e114a3b55 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:09.607007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cecea5-5a88-4212-ac5f-3d0b03bc62cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:09.607647 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cecea5-5a88-4212-ac5f-3d0b03bc62cf service swift] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:09.607951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cecea5-5a88-4212-ac5f-3d0b03bc62cf service swift] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:09.608247 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cecea5-5a88-4212-ac5f-3d0b03bc62cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:09.616563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cecea5-5a88-4212-ac5f-3d0b03bc62cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:09.618295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cecea5-5a88-4212-ac5f-3d0b03bc62cf service swift] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:09.626439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1149/2292] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:22:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:22:13.344066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dec59-3d58-4fad-a76a-f6f3d50c6ad6 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:13.346090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-565dec59-3d58-4fad-a76a-f6f3d50c6ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:13.435578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dec59-3d58-4fad-a76a-f6f3d50c6ad6 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:13.442044 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:13.443680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:13.444114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:13.444300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] PATH_INFO: `/v3/users/2a3a4f2d2d5b45508139a28712bc691e` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:13.445582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a3a4f2d2d5b45508139a28712bc691e)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:13.452140 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:13.797240 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a3a4f2d2d5b45508139a28712bc691e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:13.811053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a3a4f2d2d5b45508139a28712bc691e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:13.819606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a3a4f2d2d5b45508139a28712bc691e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:13.823860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a3a4f2d2d5b45508139a28712bc691e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:13.903734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a3a4f2d2d5b45508139a28712bc691e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:13.918530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1144/2293] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:22:13 2021] DELETE /identity/v3/users/2a3a4f2d2d5b45508139a28712bc691e => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:13.918643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffadf53-f6fa-4054-a0da-461a4803502f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:13.918643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffadf53-f6fa-4054-a0da-461a4803502f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:13.918643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffadf53-f6fa-4054-a0da-461a4803502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:13.935583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-0ffadf53-f6fa-4054-a0da-461a4803502f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:13.937218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0ffadf53-f6fa-4054-a0da-461a4803502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:14.006105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1150/2294] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:14.016392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:14.017811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:14.089672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2110c9c3-1fa4-411b-8e35-574512926c64 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:14.094116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470a840-ca6a-4072-a992-7262aad31e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:14.094791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a840-ca6a-4072-a992-7262aad31e09 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:14.095074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a840-ca6a-4072-a992-7262aad31e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:14.095348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470a840-ca6a-4072-a992-7262aad31e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:14.107031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470a840-ca6a-4072-a992-7262aad31e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:14.108507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470a840-ca6a-4072-a992-7262aad31e09 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:14.131273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1145/2295] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:15.114756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffadf53-f6fa-4054-a0da-461a4803502f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:15.116282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0ffadf53-f6fa-4054-a0da-461a4803502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:15.127662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffadf53-f6fa-4054-a0da-461a4803502f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:15.141224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:15.143946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:15.143946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:15.143946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] PATH_INFO: `/v3/projects/cb304d84cca84829a927f7602f1eb969` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:15.143946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb304d84cca84829a927f7602f1eb969)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:15.146395 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:15.313442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb304d84cca84829a927f7602f1eb969', 'request_id': 'req-1e612b83-f11d-45b9-92aa-824b8d4bf59b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:15.322377 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb304d84cca84829a927f7602f1eb969', 'request_id': 'req-1e612b83-f11d-45b9-92aa-824b8d4bf59b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:15.328387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb304d84cca84829a927f7602f1eb969', 'request_id': 'req-1e612b83-f11d-45b9-92aa-824b8d4bf59b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:15.463092 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] The token cache is being invalidate because project cb304d84cca84829a927f7602f1eb969 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:22:15.463688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:15.464606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1e612b83-f11d-45b9-92aa-824b8d4bf59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:15.466704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1151/2296] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:22:15 2021] DELETE /identity/v3/projects/cb304d84cca84829a927f7602f1eb969 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:15.472503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48793-b3d7-4e1f-9cf6-061ecdb14de6 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:15.473103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48793-b3d7-4e1f-9cf6-061ecdb14de6 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:15.473103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c48793-b3d7-4e1f-9cf6-061ecdb14de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:15.507916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-03c48793-b3d7-4e1f-9cf6-061ecdb14de6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:15.509047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-03c48793-b3d7-4e1f-9cf6-061ecdb14de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:15.569022 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1146/2297] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:15.582475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043408d1-da06-4a5b-8ed2-2d7d9a3d5690 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:15.582791 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043408d1-da06-4a5b-8ed2-2d7d9a3d5690 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:15.583055 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043408d1-da06-4a5b-8ed2-2d7d9a3d5690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:15.601585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-043408d1-da06-4a5b-8ed2-2d7d9a3d5690 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:15.602936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-043408d1-da06-4a5b-8ed2-2d7d9a3d5690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:15.611513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1152/2298] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:15.616767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c48793-b3d7-4e1f-9cf6-061ecdb14de6 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:15.626166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c48793-b3d7-4e1f-9cf6-061ecdb14de6 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:15.631009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a379-8a5b-4f80-b90b-084d7f32ec90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:15.631700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a379-8a5b-4f80-b90b-084d7f32ec90 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:15.631977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a379-8a5b-4f80-b90b-084d7f32ec90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:15.632249 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f0a379-8a5b-4f80-b90b-084d7f32ec90 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:15.632986 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a379-8a5b-4f80-b90b-084d7f32ec90 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:15.633284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a379-8a5b-4f80-b90b-084d7f32ec90 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:15.634966 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f0a379-8a5b-4f80-b90b-084d7f32ec90 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:15.649842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1147/2299] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:22:15 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:15.651784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043408d1-da06-4a5b-8ed2-2d7d9a3d5690 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:15.660368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043408d1-da06-4a5b-8ed2-2d7d9a3d5690 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:15.672033 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64ac21-47d1-4128-931e-37d3197da00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:15.672792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64ac21-47d1-4128-931e-37d3197da00a admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:15.673134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64ac21-47d1-4128-931e-37d3197da00a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:15.673475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca64ac21-47d1-4128-931e-37d3197da00a admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:15.674323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64ac21-47d1-4128-931e-37d3197da00a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:15.676706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca64ac21-47d1-4128-931e-37d3197da00a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:15.820374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1153/2300] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:22:15 2021] POST /identity/v3/projects => generated 375 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:22:15.824490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a379-8a5b-4f80-b90b-084d7f32ec90 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:15.834476 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f0a379-8a5b-4f80-b90b-084d7f32ec90 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:15.897518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fb282-3a28-4b53-ae67-793fd96d0f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:15.898219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fb282-3a28-4b53-ae67-793fd96d0f86 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:15.898502 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fb282-3a28-4b53-ae67-793fd96d0f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:15.898780 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002fb282-3a28-4b53-ae67-793fd96d0f86 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:15.899606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fb282-3a28-4b53-ae67-793fd96d0f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:15.901498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002fb282-3a28-4b53-ae67-793fd96d0f86 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:15.999036 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1148/2301] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:22:15 2021] POST /identity/v3/users => generated 288 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:22:16.006821 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64ac21-47d1-4128-931e-37d3197da00a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.014510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca64ac21-47d1-4128-931e-37d3197da00a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.019237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820bd89-4c14-4ddd-814e-f57ce76d90b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.019980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820bd89-4c14-4ddd-814e-f57ce76d90b3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.020259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820bd89-4c14-4ddd-814e-f57ce76d90b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.020633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8820bd89-4c14-4ddd-814e-f57ce76d90b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.021783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820bd89-4c14-4ddd-814e-f57ce76d90b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.023470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8820bd89-4c14-4ddd-814e-f57ce76d90b3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.034148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1154/2302] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:16.050208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fb282-3a28-4b53-ae67-793fd96d0f86 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.057310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002fb282-3a28-4b53-ae67-793fd96d0f86 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.063562 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4a9820-5927-4cc1-a9ce-118842627ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.064286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a9820-5927-4cc1-a9ce-118842627ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.064684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a9820-5927-4cc1-a9ce-118842627ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.065043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4a9820-5927-4cc1-a9ce-118842627ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.065922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a9820-5927-4cc1-a9ce-118842627ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.068362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4a9820-5927-4cc1-a9ce-118842627ee8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.083266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1149/2303] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:16.084929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820bd89-4c14-4ddd-814e-f57ce76d90b3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.096047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8820bd89-4c14-4ddd-814e-f57ce76d90b3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.102785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7ea9-b241-488f-9744-e1774247defc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.103952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7ea9-b241-488f-9744-e1774247defc admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.104477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7ea9-b241-488f-9744-e1774247defc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.104859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cc7ea9-b241-488f-9744-e1774247defc admin admin] PATH_INFO: `/v3/projects/c000c37c90a645ec9c213ee8ef33a963/users/3bc3e857046f4124a7e05cf82dba185e/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.121633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc7ea9-b241-488f-9744-e1774247defc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c000c37c90a645ec9c213ee8ef33a963, user_id=3bc3e857046f4124a7e05cf82dba185e, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.124387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cc7ea9-b241-488f-9744-e1774247defc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.219555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1155/2304] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:22:16 2021] PUT /identity/v3/projects/c000c37c90a645ec9c213ee8ef33a963/users/3bc3e857046f4124a7e05cf82dba185e/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:16.231481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7504f-241e-4238-80aa-93cf43e6e1cc None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.231809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7504f-241e-4238-80aa-93cf43e6e1cc None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.232086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7504f-241e-4238-80aa-93cf43e6e1cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.261446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-94f7504f-241e-4238-80aa-93cf43e6e1cc None None] MFA Rules not processed for user `3bc3e857046f4124a7e05cf82dba185e`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:16.262916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-94f7504f-241e-4238-80aa-93cf43e6e1cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:16.328841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1150/2305] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:16 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:16.334099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7ea9-b241-488f-9744-e1774247defc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.403494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cc7ea9-b241-488f-9744-e1774247defc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.407933 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0bc28-c2df-42e8-a56c-2f575095dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.408587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0bc28-c2df-42e8-a56c-2f575095dead admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.408863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0bc28-c2df-42e8-a56c-2f575095dead admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.409140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace0bc28-c2df-42e8-a56c-2f575095dead admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.409833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0bc28-c2df-42e8-a56c-2f575095dead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.411862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace0bc28-c2df-42e8-a56c-2f575095dead admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.555202 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1156/2306] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:22:16 2021] POST /identity/v3/projects => generated 377 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:22:16.559616 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7504f-241e-4238-80aa-93cf43e6e1cc None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.573101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7504f-241e-4238-80aa-93cf43e6e1cc None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.665971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a114d-41dc-499b-bdea-5af8d656c9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.666995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a114d-41dc-499b-bdea-5af8d656c9b8 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.667275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a114d-41dc-499b-bdea-5af8d656c9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.667543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a114d-41dc-499b-bdea-5af8d656c9b8 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.668377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a114d-41dc-499b-bdea-5af8d656c9b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.670311 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6a114d-41dc-499b-bdea-5af8d656c9b8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.796552 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1151/2307] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:22:16 2021] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:22:16.797927 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0bc28-c2df-42e8-a56c-2f575095dead admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.808262 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace0bc28-c2df-42e8-a56c-2f575095dead admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.812768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149aefb-972c-44dc-a517-f513a0e0cc02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.813488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149aefb-972c-44dc-a517-f513a0e0cc02 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.813826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149aefb-972c-44dc-a517-f513a0e0cc02 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.814194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149aefb-972c-44dc-a517-f513a0e0cc02 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.815118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149aefb-972c-44dc-a517-f513a0e0cc02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.816833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149aefb-972c-44dc-a517-f513a0e0cc02 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.828224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1157/2308] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:16.832095 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a114d-41dc-499b-bdea-5af8d656c9b8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.843087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a114d-41dc-499b-bdea-5af8d656c9b8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.847818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9ac31-c333-411d-820d-3d4ae28161f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.848488 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ac31-c333-411d-820d-3d4ae28161f2 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.848820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ac31-c333-411d-820d-3d4ae28161f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.849104 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9ac31-c333-411d-820d-3d4ae28161f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.850156 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9ac31-c333-411d-820d-3d4ae28161f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.851733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9ac31-c333-411d-820d-3d4ae28161f2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:16.862886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1152/2309] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:16 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:16.867717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149aefb-972c-44dc-a517-f513a0e0cc02 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:16.878247 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149aefb-972c-44dc-a517-f513a0e0cc02 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:16.884352 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129d5a-42a8-4ee1-8135-7eab182ffb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:16.885157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129d5a-42a8-4ee1-8135-7eab182ffb9d admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:16.885496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129d5a-42a8-4ee1-8135-7eab182ffb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:16.885869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f129d5a-42a8-4ee1-8135-7eab182ffb9d admin admin] PATH_INFO: `/v3/projects/7259c0d553d9444586610917256672d6/users/cdeb3acf3c724f04a7a184e3a07848c4/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:16.903083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129d5a-42a8-4ee1-8135-7eab182ffb9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7259c0d553d9444586610917256672d6, user_id=cdeb3acf3c724f04a7a184e3a07848c4, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:16.905976 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f129d5a-42a8-4ee1-8135-7eab182ffb9d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:17.064849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1158/2310] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:22:16 2021] PUT /identity/v3/projects/7259c0d553d9444586610917256672d6/users/cdeb3acf3c724f04a7a184e3a07848c4/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:22:17.076957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbde6d-f7b2-48f0-a4fc-17879f4f78e9 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:17.077246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbde6d-f7b2-48f0-a4fc-17879f4f78e9 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:17.077517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbde6d-f7b2-48f0-a4fc-17879f4f78e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:17.106315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-cefbde6d-f7b2-48f0-a4fc-17879f4f78e9 None None] MFA Rules not processed for user `cdeb3acf3c724f04a7a184e3a07848c4`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:17.107509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-cefbde6d-f7b2-48f0-a4fc-17879f4f78e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:17.182442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1153/2311] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:17 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:17.192871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129d5a-42a8-4ee1-8135-7eab182ffb9d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:17.259534 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f129d5a-42a8-4ee1-8135-7eab182ffb9d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:17.264659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d96a7-3946-4d2d-82be-c155eb868c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:17.265427 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d96a7-3946-4d2d-82be-c155eb868c81 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:17.265715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d96a7-3946-4d2d-82be-c155eb868c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:17.265992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d96a7-3946-4d2d-82be-c155eb868c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:17.266720 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d96a7-3946-4d2d-82be-c155eb868c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:17.268624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d96a7-3946-4d2d-82be-c155eb868c81 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:17.390921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1159/2312] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:22:17 2021] POST /identity/v3/projects => generated 377 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:22:17.394972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbde6d-f7b2-48f0-a4fc-17879f4f78e9 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:17.405513 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbde6d-f7b2-48f0-a4fc-17879f4f78e9 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:17.465058 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b3230-7000-4cbc-a7a4-d9e4c2aa861c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:17.465811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b3230-7000-4cbc-a7a4-d9e4c2aa861c admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:17.466124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b3230-7000-4cbc-a7a4-d9e4c2aa861c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:17.466397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b3230-7000-4cbc-a7a4-d9e4c2aa861c admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:17.467277 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b3230-7000-4cbc-a7a4-d9e4c2aa861c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:17.469242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b3230-7000-4cbc-a7a4-d9e4c2aa861c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:17.561204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1154/2313] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:22:17 2021] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:22:17.565270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d96a7-3946-4d2d-82be-c155eb868c81 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:17.576400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d96a7-3946-4d2d-82be-c155eb868c81 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:17.581024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e292c-4752-4991-8af1-f437eb152d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:17.586621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e292c-4752-4991-8af1-f437eb152d6c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:17.586621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e292c-4752-4991-8af1-f437eb152d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:17.586621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e292c-4752-4991-8af1-f437eb152d6c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:17.586621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e292c-4752-4991-8af1-f437eb152d6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:17.586621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e292c-4752-4991-8af1-f437eb152d6c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:17.595251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1160/2314] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:17 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:17.599392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b3230-7000-4cbc-a7a4-d9e4c2aa861c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:17.609569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b3230-7000-4cbc-a7a4-d9e4c2aa861c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:17.614157 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874d792-e7aa-491c-be4f-cf5fb8362a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:17.615691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874d792-e7aa-491c-be4f-cf5fb8362a0f admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:17.615990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874d792-e7aa-491c-be4f-cf5fb8362a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:17.616270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f874d792-e7aa-491c-be4f-cf5fb8362a0f admin admin] PATH_INFO: `/v3/projects/e74bda80758c480d823bee196d714d12/users/ad61871f3842410d9b251285fb8f3338/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:17.636741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874d792-e7aa-491c-be4f-cf5fb8362a0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74bda80758c480d823bee196d714d12, user_id=ad61871f3842410d9b251285fb8f3338, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:17.643912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f874d792-e7aa-491c-be4f-cf5fb8362a0f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:17.733381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1155/2315] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:22:17 2021] PUT /identity/v3/projects/e74bda80758c480d823bee196d714d12/users/ad61871f3842410d9b251285fb8f3338/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:17.739033 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e292c-4752-4991-8af1-f437eb152d6c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:17.748714 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e292c-4752-4991-8af1-f437eb152d6c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:17.858252 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a6b19-cddf-443d-9b11-ac06852d0b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:17.858912 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a6b19-cddf-443d-9b11-ac06852d0b4b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:17.859191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a6b19-cddf-443d-9b11-ac06852d0b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:17.859595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a6b19-cddf-443d-9b11-ac06852d0b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:17.860359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a6b19-cddf-443d-9b11-ac06852d0b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:17.862055 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a6b19-cddf-443d-9b11-ac06852d0b4b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:17.872307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1161/2316] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:17 2021] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:17.876402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874d792-e7aa-491c-be4f-cf5fb8362a0f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:17.887600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f874d792-e7aa-491c-be4f-cf5fb8362a0f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:17.892402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ecbef-6d20-4717-bf41-8f60fd818dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:17.893408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ecbef-6d20-4717-bf41-8f60fd818dd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:17.893814 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ecbef-6d20-4717-bf41-8f60fd818dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:17.894319 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ecbef-6d20-4717-bf41-8f60fd818dd5 admin admin] PATH_INFO: `/v3/projects/e74bda80758c480d823bee196d714d12/users/ad61871f3842410d9b251285fb8f3338/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:17.897086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ecbef-6d20-4717-bf41-8f60fd818dd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e74bda80758c480d823bee196d714d12, user_id=ad61871f3842410d9b251285fb8f3338, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:17.899864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ecbef-6d20-4717-bf41-8f60fd818dd5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:17.911086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1156/2317] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:22:17 2021] PUT /identity/v3/projects/e74bda80758c480d823bee196d714d12/users/ad61871f3842410d9b251285fb8f3338/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:22:17.921177 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8abf7-13f5-455f-a424-28ff41e7c519 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:17.921528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8abf7-13f5-455f-a424-28ff41e7c519 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:17.921886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8abf7-13f5-455f-a424-28ff41e7c519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:17.948492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9ab8abf7-13f5-455f-a424-28ff41e7c519 None None] MFA Rules not processed for user `ad61871f3842410d9b251285fb8f3338`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:17.949682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9ab8abf7-13f5-455f-a424-28ff41e7c519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:18.024803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1162/2318] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:17 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:18.031703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ecbef-6d20-4717-bf41-8f60fd818dd5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:18.033568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0e6ecbef-6d20-4717-bf41-8f60fd818dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:18.144916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ecbef-6d20-4717-bf41-8f60fd818dd5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:18.150945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fc81-807d-4304-b4d9-5bce18c8b0e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:18.151635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fc81-807d-4304-b4d9-5bce18c8b0e6 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:18.151919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fc81-807d-4304-b4d9-5bce18c8b0e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:18.152194 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58fc81-807d-4304-b4d9-5bce18c8b0e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:18.215307 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58fc81-807d-4304-b4d9-5bce18c8b0e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:18.216759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58fc81-807d-4304-b4d9-5bce18c8b0e6 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:18.233618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1157/2319] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:18 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:21.698341 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8abf7-13f5-455f-a424-28ff41e7c519 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:21.707751 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8abf7-13f5-455f-a424-28ff41e7c519 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:21.711662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a26dc-be4d-4c2d-8ea8-8b80cd5ecfa1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:21.712657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a26dc-be4d-4c2d-8ea8-8b80cd5ecfa1 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:21.712935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a26dc-be4d-4c2d-8ea8-8b80cd5ecfa1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:21.713202 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a26dc-be4d-4c2d-8ea8-8b80cd5ecfa1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:21.782366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a26dc-be4d-4c2d-8ea8-8b80cd5ecfa1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:21.784672 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a26dc-be4d-4c2d-8ea8-8b80cd5ecfa1 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:21.797887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1163/2320] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:21 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:23.789800 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fc81-807d-4304-b4d9-5bce18c8b0e6 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:23.802064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58fc81-807d-4304-b4d9-5bce18c8b0e6 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:23.803005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4472169-9f9a-4a2e-87d0-ab91126edd31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:23.803881 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472169-9f9a-4a2e-87d0-ab91126edd31 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:23.804220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472169-9f9a-4a2e-87d0-ab91126edd31 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:23.804609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4472169-9f9a-4a2e-87d0-ab91126edd31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:23.814165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472169-9f9a-4a2e-87d0-ab91126edd31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:23.818290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4472169-9f9a-4a2e-87d0-ab91126edd31 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:23.825952 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1158/2321] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:23 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:26.186902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ac576-65e3-43cb-a203-13f28473ff99 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:26.187366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ac576-65e3-43cb-a203-13f28473ff99 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:26.187470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6ac576-65e3-43cb-a203-13f28473ff99 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:26.189206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1164/2322] 10.222.0.32 () {54 vars in 960 bytes} [Wed Oct 27 01:22:26 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:22:26.194647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1983ee9-0f36-4c71-a7c7-fc09251d9ac4 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:26.195118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1983ee9-0f36-4c71-a7c7-fc09251d9ac4 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:26.195224 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1983ee9-0f36-4c71-a7c7-fc09251d9ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:26.244415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-a1983ee9-0f36-4c71-a7c7-fc09251d9ac4 None None] MFA Rules not processed for user `8df6e02fde834883aef230f31d6ecd94`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:26.245694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a1983ee9-0f36-4c71-a7c7-fc09251d9ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:26.317310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1159/2323] 10.222.0.32 () {58 vars in 1057 bytes} [Wed Oct 27 01:22:26 2021] POST /identity/v3/auth/tokens => generated 3451 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:22:26.326819 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ac576-65e3-43cb-a203-13f28473ff99 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:26.341379 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6ac576-65e3-43cb-a203-13f28473ff99 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:26.346541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc75a6-5570-4b1c-937a-61b5749f782c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8df6e02fde834883aef230f31d6ecd94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:26.347172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc75a6-5570-4b1c-937a-61b5749f782c service placement] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:26.347515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc75a6-5570-4b1c-937a-61b5749f782c service placement] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:26.347906 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc75a6-5570-4b1c-937a-61b5749f782c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:26.351228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b5bc75a6-5570-4b1c-937a-61b5749f782c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:26.364403 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc75a6-5570-4b1c-937a-61b5749f782c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:26.366009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc75a6-5570-4b1c-937a-61b5749f782c service placement] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:26.376269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1165/2324] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:26 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:28.887537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1983ee9-0f36-4c71-a7c7-fc09251d9ac4 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:28.960949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1983ee9-0f36-4c71-a7c7-fc09251d9ac4 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:28.972228 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:28.973114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:28.973582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:28.973879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] PATH_INFO: `/v3/users/3bc3e857046f4124a7e05cf82dba185e` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:28.975137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bc3e857046f4124a7e05cf82dba185e)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:28.977141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:29.173718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bc3e857046f4124a7e05cf82dba185e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:29.185029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bc3e857046f4124a7e05cf82dba185e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:29.191483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bc3e857046f4124a7e05cf82dba185e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:29.192644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bc3e857046f4124a7e05cf82dba185e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:29.266765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bc3e857046f4124a7e05cf82dba185e'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:29.274274 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1160/2325] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:22:28 2021] DELETE /identity/v3/users/3bc3e857046f4124a7e05cf82dba185e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:29.279597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8276344-2dcf-48ab-bec2-89693f9a6156 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:29.280114 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8276344-2dcf-48ab-bec2-89693f9a6156 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:29.280213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8276344-2dcf-48ab-bec2-89693f9a6156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:29.305645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c8276344-2dcf-48ab-bec2-89693f9a6156 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:29.306874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c8276344-2dcf-48ab-bec2-89693f9a6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:29.363592 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1166/2326] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:29 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:22:29.374370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:29.375754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:29.434118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e836da-8b0d-4d39-b681-cf4b63bbc16e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:29.437697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581cc1c-c924-4b89-a8de-e5a3bc1801ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:29.438377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581cc1c-c924-4b89-a8de-e5a3bc1801ab service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:29.438655 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581cc1c-c924-4b89-a8de-e5a3bc1801ab service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:29.438923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581cc1c-c924-4b89-a8de-e5a3bc1801ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:29.448438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581cc1c-c924-4b89-a8de-e5a3bc1801ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:29.449905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581cc1c-c924-4b89-a8de-e5a3bc1801ab service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:29.459371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1161/2327] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:29 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:29.897520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8276344-2dcf-48ab-bec2-89693f9a6156 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:29.901473 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c8276344-2dcf-48ab-bec2-89693f9a6156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:29.916709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8276344-2dcf-48ab-bec2-89693f9a6156 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:29.923275 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:29.925151 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:29.925444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:29.925725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] PATH_INFO: `/v3/projects/c000c37c90a645ec9c213ee8ef33a963` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:29.927942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c000c37c90a645ec9c213ee8ef33a963)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:29.929966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:30.061293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c000c37c90a645ec9c213ee8ef33a963', 'request_id': 'req-d30a8440-8827-4085-bbb5-d1c072526811'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.067967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c000c37c90a645ec9c213ee8ef33a963', 'request_id': 'req-d30a8440-8827-4085-bbb5-d1c072526811'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.073886 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c000c37c90a645ec9c213ee8ef33a963', 'request_id': 'req-d30a8440-8827-4085-bbb5-d1c072526811'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.177614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] The token cache is being invalidate because project c000c37c90a645ec9c213ee8ef33a963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:22:30.177907 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.178570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.180083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1167/2328] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:22:29 2021] DELETE /identity/v3/projects/c000c37c90a645ec9c213ee8ef33a963 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:22:30.184055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581cc1c-c924-4b89-a8de-e5a3bc1801ab service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:30.193972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581cc1c-c924-4b89-a8de-e5a3bc1801ab service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:30.248504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:30.249361 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:30.249640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:30.249912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] PATH_INFO: `/v3/users/cdeb3acf3c724f04a7a184e3a07848c4` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:30.251173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdeb3acf3c724f04a7a184e3a07848c4)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:30.253043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:30.477536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdeb3acf3c724f04a7a184e3a07848c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.489812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdeb3acf3c724f04a7a184e3a07848c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.496340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdeb3acf3c724f04a7a184e3a07848c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.496988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdeb3acf3c724f04a7a184e3a07848c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.575058 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdeb3acf3c724f04a7a184e3a07848c4'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:30.582368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1162/2329] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:22:30 2021] DELETE /identity/v3/users/cdeb3acf3c724f04a7a184e3a07848c4 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:31.049181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:31.051188 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:31.077056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a8440-8827-4085-bbb5-d1c072526811 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:31.135192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:31.136053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:31.136328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:31.136599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] PATH_INFO: `/v3/projects/7259c0d553d9444586610917256672d6` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:31.137789 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7259c0d553d9444586610917256672d6)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:31.139734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:31.246238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7259c0d553d9444586610917256672d6', 'request_id': 'req-8e9a3667-d348-481a-bbc1-fddeeedb3d09'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.252290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7259c0d553d9444586610917256672d6', 'request_id': 'req-8e9a3667-d348-481a-bbc1-fddeeedb3d09'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.258865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7259c0d553d9444586610917256672d6', 'request_id': 'req-8e9a3667-d348-481a-bbc1-fddeeedb3d09'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.338598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] The token cache is being invalidate because project 7259c0d553d9444586610917256672d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:22:31.338818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.339496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.341297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1168/2330] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:22:31 2021] DELETE /identity/v3/projects/7259c0d553d9444586610917256672d6 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:31.345141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:31.346556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:31.360699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe41f-389a-4f1a-a44f-83ff599f5bee admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:31.425997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:31.427123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:31.427452 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:31.427728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] PATH_INFO: `/v3/users/ad61871f3842410d9b251285fb8f3338` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:31.428941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad61871f3842410d9b251285fb8f3338)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:31.430972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:31.642387 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad61871f3842410d9b251285fb8f3338'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.654617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad61871f3842410d9b251285fb8f3338'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.661256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad61871f3842410d9b251285fb8f3338'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.661929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad61871f3842410d9b251285fb8f3338'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.763523 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fb348c0a-a906-4cd1-8158-00ecc0002e59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad61871f3842410d9b251285fb8f3338'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:31.769911 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1163/2331] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:22:31 2021] DELETE /identity/v3/users/ad61871f3842410d9b251285fb8f3338 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:32.214232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:32.215712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:32.229442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a3667-d348-481a-bbc1-fddeeedb3d09 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:32.287716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:32.288602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:32.288876 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:32.289146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] PATH_INFO: `/v3/projects/e74bda80758c480d823bee196d714d12` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:32.290336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e74bda80758c480d823bee196d714d12)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:32.292213 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:32.402620 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e74bda80758c480d823bee196d714d12', 'request_id': 'req-24b41a03-25ad-4123-bd92-4a78746da328'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:32.408722 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e74bda80758c480d823bee196d714d12', 'request_id': 'req-24b41a03-25ad-4123-bd92-4a78746da328'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:32.413994 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e74bda80758c480d823bee196d714d12', 'request_id': 'req-24b41a03-25ad-4123-bd92-4a78746da328'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:32.486280 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] The token cache is being invalidate because project e74bda80758c480d823bee196d714d12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:22:32.486496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:32.487086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-24b41a03-25ad-4123-bd92-4a78746da328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:32.489398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1169/2332] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:22:32 2021] DELETE /identity/v3/projects/e74bda80758c480d823bee196d714d12 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:32.494875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d8e83-0e6a-4eff-9741-1f6b87b31c67 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:32.500217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d8e83-0e6a-4eff-9741-1f6b87b31c67 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:32.500217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d8e83-0e6a-4eff-9741-1f6b87b31c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:32.513753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-cf3d8e83-0e6a-4eff-9741-1f6b87b31c67 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:32.514989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-cf3d8e83-0e6a-4eff-9741-1f6b87b31c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:32.573316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1164/2333] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:22:32.581698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b0910-54d3-4f14-8606-fbe22785ff59 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:32.582068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b0910-54d3-4f14-8606-fbe22785ff59 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:32.582291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37b0910-54d3-4f14-8606-fbe22785ff59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:32.603307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f37b0910-54d3-4f14-8606-fbe22785ff59 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:32.604505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f37b0910-54d3-4f14-8606-fbe22785ff59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:32.612986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1170/2334] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:32 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:32.617858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d8e83-0e6a-4eff-9741-1f6b87b31c67 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:32.627390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d8e83-0e6a-4eff-9741-1f6b87b31c67 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:32.632675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a4e2d-8a18-41f7-a1ab-bba5bf91d1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:32.633518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a4e2d-8a18-41f7-a1ab-bba5bf91d1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:32.633795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a4e2d-8a18-41f7-a1ab-bba5bf91d1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:32.634097 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a4e2d-8a18-41f7-a1ab-bba5bf91d1e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:32.634834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a4e2d-8a18-41f7-a1ab-bba5bf91d1e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:32.635138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a4e2d-8a18-41f7-a1ab-bba5bf91d1e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:32.636712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a4e2d-8a18-41f7-a1ab-bba5bf91d1e3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:32.652142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1165/2335] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:22:32 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:32.653243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b0910-54d3-4f14-8606-fbe22785ff59 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:32.663104 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37b0910-54d3-4f14-8606-fbe22785ff59 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:32.667744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cb69-202a-453e-b083-6429fcc1f6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:32.668386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cb69-202a-453e-b083-6429fcc1f6b2 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:32.668667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cb69-202a-453e-b083-6429fcc1f6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:32.668940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02cb69-202a-453e-b083-6429fcc1f6b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:32.669639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02cb69-202a-453e-b083-6429fcc1f6b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:32.671534 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02cb69-202a-453e-b083-6429fcc1f6b2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:32.810645 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1171/2336] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:22:32 2021] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:22:32.814896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a4e2d-8a18-41f7-a1ab-bba5bf91d1e3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:32.825412 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a4e2d-8a18-41f7-a1ab-bba5bf91d1e3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:32.881284 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9360e0c-9986-48b9-9442-158c85d22b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:32.881868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9360e0c-9986-48b9-9442-158c85d22b32 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:32.882189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9360e0c-9986-48b9-9442-158c85d22b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:32.882457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9360e0c-9986-48b9-9442-158c85d22b32 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:32.883172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9360e0c-9986-48b9-9442-158c85d22b32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:32.885058 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9360e0c-9986-48b9-9442-158c85d22b32 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:32.996177 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1166/2337] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:22:32 2021] POST /identity/v3/users => generated 288 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:22:33.007355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cb69-202a-453e-b083-6429fcc1f6b2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:33.017639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02cb69-202a-453e-b083-6429fcc1f6b2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:33.022947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b6b65-5230-4cb1-b502-18a16cdb486a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:33.023598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b6b65-5230-4cb1-b502-18a16cdb486a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:33.023875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b6b65-5230-4cb1-b502-18a16cdb486a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:33.024145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79b6b65-5230-4cb1-b502-18a16cdb486a admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:33.024874 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b6b65-5230-4cb1-b502-18a16cdb486a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:33.026486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79b6b65-5230-4cb1-b502-18a16cdb486a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:33.036747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1172/2338] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:33 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:33.041001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9360e0c-9986-48b9-9442-158c85d22b32 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:33.051896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9360e0c-9986-48b9-9442-158c85d22b32 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:33.058295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cd3e5c-bea3-49c3-915d-33fc672a1c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:33.058295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd3e5c-bea3-49c3-915d-33fc672a1c95 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:33.058295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd3e5c-bea3-49c3-915d-33fc672a1c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:33.058295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cd3e5c-bea3-49c3-915d-33fc672a1c95 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:33.058901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd3e5c-bea3-49c3-915d-33fc672a1c95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:33.060471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cd3e5c-bea3-49c3-915d-33fc672a1c95 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:33.071060 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1167/2339] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:33 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:33.075029 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b6b65-5230-4cb1-b502-18a16cdb486a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:33.085173 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79b6b65-5230-4cb1-b502-18a16cdb486a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:33.089807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8125685-0447-45bb-b658-0be33e364c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:33.090736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8125685-0447-45bb-b658-0be33e364c04 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:33.091019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8125685-0447-45bb-b658-0be33e364c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:33.091292 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8125685-0447-45bb-b658-0be33e364c04 admin admin] PATH_INFO: `/v3/projects/62ba4e49116c4783802852db9449300f/users/b6fd88eadf134e8a8a474e598c8c3bf6/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:33.106105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8125685-0447-45bb-b658-0be33e364c04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62ba4e49116c4783802852db9449300f, user_id=b6fd88eadf134e8a8a474e598c8c3bf6, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:33.108755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8125685-0447-45bb-b658-0be33e364c04 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:33.175060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1173/2340] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:22:33 2021] PUT /identity/v3/projects/62ba4e49116c4783802852db9449300f/users/b6fd88eadf134e8a8a474e598c8c3bf6/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:22:33.186244 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf13e4-0109-4734-944b-7c9a59df03cd None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:33.186648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf13e4-0109-4734-944b-7c9a59df03cd None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:33.187019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faf13e4-0109-4734-944b-7c9a59df03cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:33.215103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-0faf13e4-0109-4734-944b-7c9a59df03cd None None] MFA Rules not processed for user `b6fd88eadf134e8a8a474e598c8c3bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:33.216381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0faf13e4-0109-4734-944b-7c9a59df03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:33.284863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1168/2341] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:33 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:33.291737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8125685-0447-45bb-b658-0be33e364c04 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:33.293502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b8125685-0447-45bb-b658-0be33e364c04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:33.349606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8125685-0447-45bb-b658-0be33e364c04 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:33.353278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d5dec6-20a0-4846-9369-d0014261d2db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:33.353921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5dec6-20a0-4846-9369-d0014261d2db service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:33.354232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5dec6-20a0-4846-9369-d0014261d2db service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:33.354507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d5dec6-20a0-4846-9369-d0014261d2db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:33.363373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5dec6-20a0-4846-9369-d0014261d2db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:33.365520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d5dec6-20a0-4846-9369-d0014261d2db service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:33.374575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1174/2342] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:33 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:34.299019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf13e4-0109-4734-944b-7c9a59df03cd None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:34.300433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0faf13e4-0109-4734-944b-7c9a59df03cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:34.357421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faf13e4-0109-4734-944b-7c9a59df03cd None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:34.360979 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc7d0ac-7e84-493a-8d2b-168a3cfbf614 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:34.361624 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d0ac-7e84-493a-8d2b-168a3cfbf614 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:34.361945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d0ac-7e84-493a-8d2b-168a3cfbf614 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:34.362266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc7d0ac-7e84-493a-8d2b-168a3cfbf614 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:34.364141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8fc7d0ac-7e84-493a-8d2b-168a3cfbf614 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:34.426743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7d0ac-7e84-493a-8d2b-168a3cfbf614 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:34.428376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc7d0ac-7e84-493a-8d2b-168a3cfbf614 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:34.445919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1169/2343] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:34 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:36.237968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbde4e9-88f7-4d07-a173-86cc449f914b None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:36.238562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbde4e9-88f7-4d07-a173-86cc449f914b None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:36.238562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbde4e9-88f7-4d07-a173-86cc449f914b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:36.255689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-bbbde4e9-88f7-4d07-a173-86cc449f914b None None] MFA Rules not processed for user `b6fd88eadf134e8a8a474e598c8c3bf6`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:36.256890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bbbde4e9-88f7-4d07-a173-86cc449f914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:36.263744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1175/2344] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:36 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:38.038255 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04702fe-48f8-40b3-87a1-a7aa394d57e4 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:38.038710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04702fe-48f8-40b3-87a1-a7aa394d57e4 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:38.038805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04702fe-48f8-40b3-87a1-a7aa394d57e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:38.089521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d04702fe-48f8-40b3-87a1-a7aa394d57e4 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:38.090844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d04702fe-48f8-40b3-87a1-a7aa394d57e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:38.161504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1170/2345] 10.222.0.32 () {58 vars in 967 bytes} [Wed Oct 27 01:22:38 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:38.184659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbde4e9-88f7-4d07-a173-86cc449f914b None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:38.186092 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bbbde4e9-88f7-4d07-a173-86cc449f914b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:38.277616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbde4e9-88f7-4d07-a173-86cc449f914b None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:38.282797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a835e18-b142-4e2c-81bc-a5601ab8c29a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:38.283420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835e18-b142-4e2c-81bc-a5601ab8c29a service swift] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:38.283694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835e18-b142-4e2c-81bc-a5601ab8c29a service swift] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:38.283991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a835e18-b142-4e2c-81bc-a5601ab8c29a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:38.293066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a835e18-b142-4e2c-81bc-a5601ab8c29a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:38.294732 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a835e18-b142-4e2c-81bc-a5601ab8c29a service swift] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:38.302646 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1176/2346] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:22:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:22:45.474659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04702fe-48f8-40b3-87a1-a7aa394d57e4 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:45.476144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d04702fe-48f8-40b3-87a1-a7aa394d57e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:45.550427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04702fe-48f8-40b3-87a1-a7aa394d57e4 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:45.555903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:45.557510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:45.557995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:45.558507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] PATH_INFO: `/v3/users/7093c2d62dd84ea08abdec091d658d51` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:45.560023 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7093c2d62dd84ea08abdec091d658d51)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:45.569154 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:45.776669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7093c2d62dd84ea08abdec091d658d51'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:45.793560 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7093c2d62dd84ea08abdec091d658d51'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:45.802912 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7093c2d62dd84ea08abdec091d658d51'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:45.803724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7093c2d62dd84ea08abdec091d658d51'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:45.869398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7093c2d62dd84ea08abdec091d658d51'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:45.877954 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1171/2347] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:22:45 2021] DELETE /identity/v3/users/7093c2d62dd84ea08abdec091d658d51 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:45.883452 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b57e8-582d-4479-80ec-33a3b62c9e3a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:45.883979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b57e8-582d-4479-80ec-33a3b62c9e3a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:45.883979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57b57e8-582d-4479-80ec-33a3b62c9e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:45.902635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-e57b57e8-582d-4479-80ec-33a3b62c9e3a None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:45.904002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e57b57e8-582d-4479-80ec-33a3b62c9e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:45.964488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1177/2348] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:45.975703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:45.977101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:46.041440 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3dbb0f-4f9b-492b-9d7d-65ed199f35a5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:46.045423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95700af1-d3f9-4f54-b57b-2d4a5e0ab60c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:46.046437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95700af1-d3f9-4f54-b57b-2d4a5e0ab60c service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:46.046555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95700af1-d3f9-4f54-b57b-2d4a5e0ab60c service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:46.046822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95700af1-d3f9-4f54-b57b-2d4a5e0ab60c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:46.061586 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95700af1-d3f9-4f54-b57b-2d4a5e0ab60c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:46.063053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95700af1-d3f9-4f54-b57b-2d4a5e0ab60c service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:46.077019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1172/2349] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:46.591683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b57e8-582d-4479-80ec-33a3b62c9e3a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:46.593220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e57b57e8-582d-4479-80ec-33a3b62c9e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:46.613204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57b57e8-582d-4479-80ec-33a3b62c9e3a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:46.631825 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:46.633019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:46.633295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:46.633643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] PATH_INFO: `/v3/projects/d6922c938c364681b1009bd774cb1ebf` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:46.636358 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6922c938c364681b1009bd774cb1ebf)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:46.638320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:46.801324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6922c938c364681b1009bd774cb1ebf', 'request_id': 'req-a0d85a25-394e-42f9-bf3d-96106e4957d3'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:46.810313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6922c938c364681b1009bd774cb1ebf', 'request_id': 'req-a0d85a25-394e-42f9-bf3d-96106e4957d3'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:46.816962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6922c938c364681b1009bd774cb1ebf', 'request_id': 'req-a0d85a25-394e-42f9-bf3d-96106e4957d3'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:46.886535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] The token cache is being invalidate because project d6922c938c364681b1009bd774cb1ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:22:46.887245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:46.887785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a0d85a25-394e-42f9-bf3d-96106e4957d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:46.889727 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1178/2350] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:22:46 2021] DELETE /identity/v3/projects/d6922c938c364681b1009bd774cb1ebf => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:46.896810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7e3a1-5094-4798-8f56-4ace42b6486b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:46.896810 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7e3a1-5094-4798-8f56-4ace42b6486b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:46.897373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7e3a1-5094-4798-8f56-4ace42b6486b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:46.931186 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-aec7e3a1-5094-4798-8f56-4ace42b6486b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:46.932420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-aec7e3a1-5094-4798-8f56-4ace42b6486b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:47.007690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1173/2351] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:46 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:47.016010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439f821-f996-48ca-9e07-c8eee92d5c5c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.016657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439f821-f996-48ca-9e07-c8eee92d5c5c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.017009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2439f821-f996-48ca-9e07-c8eee92d5c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.038616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-2439f821-f996-48ca-9e07-c8eee92d5c5c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:47.040295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2439f821-f996-48ca-9e07-c8eee92d5c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:47.054060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1179/2352] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:47.056633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7e3a1-5094-4798-8f56-4ace42b6486b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:47.068500 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec7e3a1-5094-4798-8f56-4ace42b6486b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:47.073490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:47.074204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.074482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.074747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.076875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:47.076875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:47.077305 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:47.089510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1174/2353] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:22:47 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:47.094743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439f821-f996-48ca-9e07-c8eee92d5c5c None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:47.106936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2439f821-f996-48ca-9e07-c8eee92d5c5c None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:47.113120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203cf59-359c-4cfa-9304-99277a6159c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:47.114511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203cf59-359c-4cfa-9304-99277a6159c5 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.115034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203cf59-359c-4cfa-9304-99277a6159c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.115404 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a203cf59-359c-4cfa-9304-99277a6159c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.116221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203cf59-359c-4cfa-9304-99277a6159c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:47.118283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a203cf59-359c-4cfa-9304-99277a6159c5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:47.216541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1180/2354] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:22:47 2021] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:22:47.221269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203cf59-359c-4cfa-9304-99277a6159c5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:47.221426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:47.223828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:47.242733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cdf4d4-c28d-4f43-982b-4ac04521582f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:47.283538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a203cf59-359c-4cfa-9304-99277a6159c5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:47.289005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d189fbd-acf1-42d7-85b0-4f7edb5e1566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:47.289681 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d189fbd-acf1-42d7-85b0-4f7edb5e1566 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.289961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d189fbd-acf1-42d7-85b0-4f7edb5e1566 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.290255 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d189fbd-acf1-42d7-85b0-4f7edb5e1566 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.290942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d189fbd-acf1-42d7-85b0-4f7edb5e1566 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:47.292818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d189fbd-acf1-42d7-85b0-4f7edb5e1566 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:47.299028 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:47.299893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.300174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.300451 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] PATH_INFO: `/v3/users/1ac05d2fe5fa40b4a18063d0d335d9e2` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.302321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ac05d2fe5fa40b4a18063d0d335d9e2)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:47.304321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:47.425829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1181/2355] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:22:47 2021] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:22:47.429631 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d189fbd-acf1-42d7-85b0-4f7edb5e1566 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:47.438680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d189fbd-acf1-42d7-85b0-4f7edb5e1566 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:47.443315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e23d8-e85b-4fc2-999b-849c6271dfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:47.443943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e23d8-e85b-4fc2-999b-849c6271dfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.444218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e23d8-e85b-4fc2-999b-849c6271dfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.444487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e23d8-e85b-4fc2-999b-849c6271dfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.445228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e23d8-e85b-4fc2-999b-849c6271dfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:47.446831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e23d8-e85b-4fc2-999b-849c6271dfc4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:47.456281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1182/2356] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:47 2021] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:22:47.460465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e23d8-e85b-4fc2-999b-849c6271dfc4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:47.469277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e23d8-e85b-4fc2-999b-849c6271dfc4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:47.474909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd928e-d7b8-4de1-b031-ee7b691a5ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:47.475529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd928e-d7b8-4de1-b031-ee7b691a5ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.475810 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd928e-d7b8-4de1-b031-ee7b691a5ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.476082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dd928e-d7b8-4de1-b031-ee7b691a5ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.476782 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd928e-d7b8-4de1-b031-ee7b691a5ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:47.478360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dd928e-d7b8-4de1-b031-ee7b691a5ca2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:47.488843 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1183/2357] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:47 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:22:47.492826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd928e-d7b8-4de1-b031-ee7b691a5ca2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:47.501710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dd928e-d7b8-4de1-b031-ee7b691a5ca2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:47.506378 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1a2ce6-db6c-407d-981f-59acdeecb35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:47.507207 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a2ce6-db6c-407d-981f-59acdeecb35c admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.507571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a2ce6-db6c-407d-981f-59acdeecb35c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.507745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1a2ce6-db6c-407d-981f-59acdeecb35c admin admin] PATH_INFO: `/v3/projects/9f513b1a9beb45d080e928db16b1da95/users/2d6a878469474b8e907515c8fc6426e5/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.522648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a2ce6-db6c-407d-981f-59acdeecb35c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f513b1a9beb45d080e928db16b1da95, user_id=2d6a878469474b8e907515c8fc6426e5, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:47.525469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1a2ce6-db6c-407d-981f-59acdeecb35c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:47.576405 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ac05d2fe5fa40b4a18063d0d335d9e2'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:47.588959 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ac05d2fe5fa40b4a18063d0d335d9e2'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:47.596740 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ac05d2fe5fa40b4a18063d0d335d9e2'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:47.597436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ac05d2fe5fa40b4a18063d0d335d9e2'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:47.604068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1184/2358] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:22:47 2021] PUT /identity/v3/projects/9f513b1a9beb45d080e928db16b1da95/users/2d6a878469474b8e907515c8fc6426e5/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:22:47.616021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c000d1-9a78-4393-9ff9-f94beaea743f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.616348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c000d1-9a78-4393-9ff9-f94beaea743f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.616622 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c000d1-9a78-4393-9ff9-f94beaea743f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.647178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-46c000d1-9a78-4393-9ff9-f94beaea743f None None] MFA Rules not processed for user `2d6a878469474b8e907515c8fc6426e5`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:47.648168 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-46c000d1-9a78-4393-9ff9-f94beaea743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:47.693095 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ac05d2fe5fa40b4a18063d0d335d9e2'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:47.704668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1175/2359] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:22:47 2021] DELETE /identity/v3/users/1ac05d2fe5fa40b4a18063d0d335d9e2 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:47.725047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1185/2360] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:47 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:47.734278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:47.741856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:47.831909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc636c37-1093-47fc-aa97-442a2d7a1dc2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:47.837233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5153021c-fdbd-4617-8015-d863624952f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:47.837944 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153021c-fdbd-4617-8015-d863624952f9 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:47.839339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153021c-fdbd-4617-8015-d863624952f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:47.839339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5153021c-fdbd-4617-8015-d863624952f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:47.910678 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153021c-fdbd-4617-8015-d863624952f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:47.910678 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5153021c-fdbd-4617-8015-d863624952f9 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:47.917204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1176/2361] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:47 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:48.048920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c000d1-9a78-4393-9ff9-f94beaea743f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:48.051616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-46c000d1-9a78-4393-9ff9-f94beaea743f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:48.147317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c000d1-9a78-4393-9ff9-f94beaea743f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:48.203900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:48.204760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:48.205051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:48.205309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] PATH_INFO: `/v3/projects/7ac535690bf24eb9bbf7d42426b21c74` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:48.206534 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ac535690bf24eb9bbf7d42426b21c74)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:48.208527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:48.350369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ac535690bf24eb9bbf7d42426b21c74', 'request_id': 'req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:48.356638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ac535690bf24eb9bbf7d42426b21c74', 'request_id': 'req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:48.361803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ac535690bf24eb9bbf7d42426b21c74', 'request_id': 'req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:48.497030 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] The token cache is being invalidate because project 7ac535690bf24eb9bbf7d42426b21c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:22:48.497314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:48.497952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a6e90003-4c5d-4a2e-8b1c-e7c77c66ce4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:22:48.499535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1186/2362] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:22:48 2021] DELETE /identity/v3/projects/7ac535690bf24eb9bbf7d42426b21c74 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:22:48.505890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb85ff-04f5-487f-9891-3c396041ac43 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:48.506213 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb85ff-04f5-487f-9891-3c396041ac43 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:48.506482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fb85ff-04f5-487f-9891-3c396041ac43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:48.523382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-40fb85ff-04f5-487f-9891-3c396041ac43 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:48.524546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-40fb85ff-04f5-487f-9891-3c396041ac43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:48.584941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1177/2363] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:48.592473 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaac52-09b4-477a-8893-40f7d4400e47 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:48.592832 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaac52-09b4-477a-8893-40f7d4400e47 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:48.593116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aaac52-09b4-477a-8893-40f7d4400e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:48.611944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-18aaac52-09b4-477a-8893-40f7d4400e47 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:48.613194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-18aaac52-09b4-477a-8893-40f7d4400e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:48.621705 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1187/2364] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:48.625891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb85ff-04f5-487f-9891-3c396041ac43 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:48.635826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fb85ff-04f5-487f-9891-3c396041ac43 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:48.640490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd03638-e4cb-42ef-b325-cb7ace3ce280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:48.641141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd03638-e4cb-42ef-b325-cb7ace3ce280 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:48.641418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd03638-e4cb-42ef-b325-cb7ace3ce280 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:48.641688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd03638-e4cb-42ef-b325-cb7ace3ce280 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:48.642459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd03638-e4cb-42ef-b325-cb7ace3ce280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:22:48.642760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd03638-e4cb-42ef-b325-cb7ace3ce280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:48.644352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd03638-e4cb-42ef-b325-cb7ace3ce280 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:48.659531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1178/2365] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:22:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:22:48.661488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaac52-09b4-477a-8893-40f7d4400e47 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:48.670624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aaac52-09b4-477a-8893-40f7d4400e47 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:48.675400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d198-0b00-4205-ae7b-13152d9ce34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:48.676885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d198-0b00-4205-ae7b-13152d9ce34d admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:48.681111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d198-0b00-4205-ae7b-13152d9ce34d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:48.681111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4d198-0b00-4205-ae7b-13152d9ce34d admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:48.681111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4d198-0b00-4205-ae7b-13152d9ce34d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:48.681111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4d198-0b00-4205-ae7b-13152d9ce34d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:48.815363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1188/2366] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:22:48 2021] POST /identity/v3/projects => generated 383 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:22:48.819691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd03638-e4cb-42ef-b325-cb7ace3ce280 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:48.829513 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd03638-e4cb-42ef-b325-cb7ace3ce280 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:48.887427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a26848-de46-42d6-bfc7-8662e72b6768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:48.888091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a26848-de46-42d6-bfc7-8662e72b6768 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:48.888400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a26848-de46-42d6-bfc7-8662e72b6768 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:48.888678 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a26848-de46-42d6-bfc7-8662e72b6768 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:48.889367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a26848-de46-42d6-bfc7-8662e72b6768 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:48.891418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a26848-de46-42d6-bfc7-8662e72b6768 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:49.003713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1179/2367] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:22:48 2021] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:22:49.009388 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d198-0b00-4205-ae7b-13152d9ce34d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:49.020434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4d198-0b00-4205-ae7b-13152d9ce34d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:49.026775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca5dc3-2772-4162-b4c1-9f9df3ab191b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:49.026775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca5dc3-2772-4162-b4c1-9f9df3ab191b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:49.027095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca5dc3-2772-4162-b4c1-9f9df3ab191b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:49.027422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca5dc3-2772-4162-b4c1-9f9df3ab191b admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:49.028324 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca5dc3-2772-4162-b4c1-9f9df3ab191b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:49.029975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca5dc3-2772-4162-b4c1-9f9df3ab191b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:49.043379 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1189/2368] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:49 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:49.047504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a26848-de46-42d6-bfc7-8662e72b6768 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:49.057288 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a26848-de46-42d6-bfc7-8662e72b6768 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:49.061848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6928ffb-2ec4-467e-983f-3a98074f6a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:49.062526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6928ffb-2ec4-467e-983f-3a98074f6a39 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:49.062802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6928ffb-2ec4-467e-983f-3a98074f6a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:49.063067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6928ffb-2ec4-467e-983f-3a98074f6a39 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:49.063794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6928ffb-2ec4-467e-983f-3a98074f6a39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:49.065376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6928ffb-2ec4-467e-983f-3a98074f6a39 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:49.092271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1180/2369] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:22:49 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:22:49.102506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca5dc3-2772-4162-b4c1-9f9df3ab191b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:49.108535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca5dc3-2772-4162-b4c1-9f9df3ab191b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:49.113237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff68b3-dfda-4b44-8a34-c9aa7195eff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:49.114561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff68b3-dfda-4b44-8a34-c9aa7195eff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:49.114847 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff68b3-dfda-4b44-8a34-c9aa7195eff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:49.115120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ff68b3-dfda-4b44-8a34-c9aa7195eff2 admin admin] PATH_INFO: `/v3/projects/0aca48cc13184200acc3cee83bf4265c/users/b35bfb19e59d4f3aa015cb094b2236fd/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:49.131222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff68b3-dfda-4b44-8a34-c9aa7195eff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aca48cc13184200acc3cee83bf4265c, user_id=b35bfb19e59d4f3aa015cb094b2236fd, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:49.133889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ff68b3-dfda-4b44-8a34-c9aa7195eff2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:49.229733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1190/2370] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:22:49 2021] PUT /identity/v3/projects/0aca48cc13184200acc3cee83bf4265c/users/b35bfb19e59d4f3aa015cb094b2236fd/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:22:49.242360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bd2cb-b4b3-46d2-879f-8b2f13c5be34 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:49.242644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bd2cb-b4b3-46d2-879f-8b2f13c5be34 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:49.242919 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5bd2cb-b4b3-46d2-879f-8b2f13c5be34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:49.260978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8b5bd2cb-b4b3-46d2-879f-8b2f13c5be34 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:49.262306 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8b5bd2cb-b4b3-46d2-879f-8b2f13c5be34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:49.328153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1181/2371] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:49 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:49.338805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff68b3-dfda-4b44-8a34-c9aa7195eff2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:49.340434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-09ff68b3-dfda-4b44-8a34-c9aa7195eff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:49.397411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ff68b3-dfda-4b44-8a34-c9aa7195eff2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:49.401124 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b301445-e3d7-4a29-9d6d-41a98c98ffc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:49.405399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b301445-e3d7-4a29-9d6d-41a98c98ffc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:49.405399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b301445-e3d7-4a29-9d6d-41a98c98ffc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:49.405399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b301445-e3d7-4a29-9d6d-41a98c98ffc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:49.412123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b301445-e3d7-4a29-9d6d-41a98c98ffc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:49.413555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b301445-e3d7-4a29-9d6d-41a98c98ffc4 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:49.423243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1191/2372] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:49 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:50.810901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c68d-2bab-44e7-bf6c-654d08af49cc None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:50.811455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c68d-2bab-44e7-bf6c-654d08af49cc None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:50.818791 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884c68d-2bab-44e7-bf6c-654d08af49cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:50.842463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8884c68d-2bab-44e7-bf6c-654d08af49cc None None] MFA Rules not processed for user `b35bfb19e59d4f3aa015cb094b2236fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:50.844202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8884c68d-2bab-44e7-bf6c-654d08af49cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:50.923098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1182/2373] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:50 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:50.934121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6064c-8c7a-4ba0-a476-74bada285218 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:50.934756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6064c-8c7a-4ba0-a476-74bada285218 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:50.934756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d6064c-8c7a-4ba0-a476-74bada285218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:50.952846 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-09d6064c-8c7a-4ba0-a476-74bada285218 None None] MFA Rules not processed for user `b35bfb19e59d4f3aa015cb094b2236fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:50.954113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-09d6064c-8c7a-4ba0-a476-74bada285218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:50.961740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1192/2374] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:22:50 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:50.972798 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884c68d-2bab-44e7-bf6c-654d08af49cc None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:50.974411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8884c68d-2bab-44e7-bf6c-654d08af49cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:51.046602 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884c68d-2bab-44e7-bf6c-654d08af49cc None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:51.052815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772da219-b207-44cf-8833-26987138e1f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:51.053455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772da219-b207-44cf-8833-26987138e1f0 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:51.053731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772da219-b207-44cf-8833-26987138e1f0 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:51.054001 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772da219-b207-44cf-8833-26987138e1f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:51.061574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772da219-b207-44cf-8833-26987138e1f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:51.063314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772da219-b207-44cf-8833-26987138e1f0 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:51.072702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1183/2375] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:22:50 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:22:55.850626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4866368-009d-4695-8f5c-1604839ade60 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:55.851556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4866368-009d-4695-8f5c-1604839ade60 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:55.852020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4866368-009d-4695-8f5c-1604839ade60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:55.875684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-a4866368-009d-4695-8f5c-1604839ade60 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:55.876896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a4866368-009d-4695-8f5c-1604839ade60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:55.935362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1193/2376] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:22:55 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:22:55.948507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772da219-b207-44cf-8833-26987138e1f0 service nova] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:55.950178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-772da219-b207-44cf-8833-26987138e1f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:56.041141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772da219-b207-44cf-8833-26987138e1f0 service nova] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:56.046166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae391c-0df0-4853-95e9-20bcdfd8ff63 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:56.046831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae391c-0df0-4853-95e9-20bcdfd8ff63 service swift] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:56.047579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae391c-0df0-4853-95e9-20bcdfd8ff63 service swift] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:56.047579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae391c-0df0-4853-95e9-20bcdfd8ff63 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:56.055843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae391c-0df0-4853-95e9-20bcdfd8ff63 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:56.057820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae391c-0df0-4853-95e9-20bcdfd8ff63 service swift] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:56.065467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1184/2377] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:22:55 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:22:57.812235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f664967-a231-4e69-aa8b-357ac7eaed7d None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:57.812655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f664967-a231-4e69-aa8b-357ac7eaed7d None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:57.812780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f664967-a231-4e69-aa8b-357ac7eaed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:57.830807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-1f664967-a231-4e69-aa8b-357ac7eaed7d None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:57.832051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1f664967-a231-4e69-aa8b-357ac7eaed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:57.839214 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1194/2378] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:22:57 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:57.853121 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae391c-0df0-4853-95e9-20bcdfd8ff63 service swift] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:57.864197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae391c-0df0-4853-95e9-20bcdfd8ff63 service swift] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:57.869212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d5e39-f7c1-49b7-87e2-dd3f7bd91b3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:57.869841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d5e39-f7c1-49b7-87e2-dd3f7bd91b3d service swift] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:57.870152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d5e39-f7c1-49b7-87e2-dd3f7bd91b3d service swift] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:57.870423 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d5e39-f7c1-49b7-87e2-dd3f7bd91b3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:57.879385 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d5e39-f7c1-49b7-87e2-dd3f7bd91b3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:57.881120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d5e39-f7c1-49b7-87e2-dd3f7bd91b3d service swift] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:57.889147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1185/2379] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:22:57 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 01:22:58.585964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef05bc-bca8-4d65-af6d-c04a1b197e47 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:58.585964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef05bc-bca8-4d65-af6d-c04a1b197e47 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:58.585964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef05bc-bca8-4d65-af6d-c04a1b197e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:58.602020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ffef05bc-bca8-4d65-af6d-c04a1b197e47 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:22:58.603173 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ffef05bc-bca8-4d65-af6d-c04a1b197e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:58.610507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1195/2380] 10.222.0.32 () {58 vars in 967 bytes} [Wed Oct 27 01:22:58 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:22:58.623816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d5e39-f7c1-49b7-87e2-dd3f7bd91b3d service swift] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:58.634758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d5e39-f7c1-49b7-87e2-dd3f7bd91b3d service swift] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:58.639885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bfad6f-036d-461d-ab02-049c0c467963 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:58.640547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfad6f-036d-461d-ab02-049c0c467963 service swift] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:58.640822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfad6f-036d-461d-ab02-049c0c467963 service swift] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:58.641090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bfad6f-036d-461d-ab02-049c0c467963 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:58.649399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfad6f-036d-461d-ab02-049c0c467963 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:58.654084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bfad6f-036d-461d-ab02-049c0c467963 service swift] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:22:58.660565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1186/2381] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:22:58 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 27 01:22:59.730531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef05bc-bca8-4d65-af6d-c04a1b197e47 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:22:59.730531 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ffef05bc-bca8-4d65-af6d-c04a1b197e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:22:59.743545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef05bc-bca8-4d65-af6d-c04a1b197e47 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:22:59.748209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:22:59.749069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:22:59.749344 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:22:59.749635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] PATH_INFO: `/v3/users/2d6a878469474b8e907515c8fc6426e5` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:22:59.750854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6a878469474b8e907515c8fc6426e5)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:22:59.758273 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:00.011742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6a878469474b8e907515c8fc6426e5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:00.025669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6a878469474b8e907515c8fc6426e5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:00.033333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6a878469474b8e907515c8fc6426e5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:00.196624 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6a878469474b8e907515c8fc6426e5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:00.197238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6a878469474b8e907515c8fc6426e5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:00.203313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1196/2382] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:22:59 2021] DELETE /identity/v3/users/2d6a878469474b8e907515c8fc6426e5 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:23:00.209929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfc207-0905-46a1-8ca1-c5c93f9d31e3 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:00.210486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfc207-0905-46a1-8ca1-c5c93f9d31e3 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:00.210486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bfc207-0905-46a1-8ca1-c5c93f9d31e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:00.228087 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-b2bfc207-0905-46a1-8ca1-c5c93f9d31e3 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:00.230444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b2bfc207-0905-46a1-8ca1-c5c93f9d31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:00.285641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1187/2383] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:23:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:00.295508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:00.296908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:00.358409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd48fa-1e43-4850-9c37-10f169ee645a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:00.362239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585af49-2712-4a5e-b1c9-56bb2d32c56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:00.362904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585af49-2712-4a5e-b1c9-56bb2d32c56e service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:00.363296 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585af49-2712-4a5e-b1c9-56bb2d32c56e service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:00.363569 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6585af49-2712-4a5e-b1c9-56bb2d32c56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:00.373274 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585af49-2712-4a5e-b1c9-56bb2d32c56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:00.374723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6585af49-2712-4a5e-b1c9-56bb2d32c56e service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:00.384482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1197/2384] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:23:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:00.989191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfc207-0905-46a1-8ca1-c5c93f9d31e3 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:00.990981 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b2bfc207-0905-46a1-8ca1-c5c93f9d31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:01.015425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bfc207-0905-46a1-8ca1-c5c93f9d31e3 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:01.021103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:01.022074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:01.022353 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:01.022732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] PATH_INFO: `/v3/projects/9f513b1a9beb45d080e928db16b1da95` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:01.028928 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f513b1a9beb45d080e928db16b1da95)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:01.030929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:01.149541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f513b1a9beb45d080e928db16b1da95', 'request_id': 'req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.155784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f513b1a9beb45d080e928db16b1da95', 'request_id': 'req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.161844 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f513b1a9beb45d080e928db16b1da95', 'request_id': 'req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.242637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] The token cache is being invalidate because project 9f513b1a9beb45d080e928db16b1da95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:23:01.243350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.243537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-e79f5efc-0249-450a-9edb-a2b5c4dfe5f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.245064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1188/2385] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:23:00 2021] DELETE /identity/v3/projects/9f513b1a9beb45d080e928db16b1da95 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:01.393271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585af49-2712-4a5e-b1c9-56bb2d32c56e service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:01.395666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-6585af49-2712-4a5e-b1c9-56bb2d32c56e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:01.407915 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6585af49-2712-4a5e-b1c9-56bb2d32c56e service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:01.465720 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:01.467277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:01.467739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:01.468014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] PATH_INFO: `/v3/users/b6fd88eadf134e8a8a474e598c8c3bf6` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:01.469386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fd88eadf134e8a8a474e598c8c3bf6)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:01.471333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:01.671270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fd88eadf134e8a8a474e598c8c3bf6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.687460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fd88eadf134e8a8a474e598c8c3bf6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.694943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fd88eadf134e8a8a474e598c8c3bf6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.786274 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fd88eadf134e8a8a474e598c8c3bf6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.790167 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fd88eadf134e8a8a474e598c8c3bf6'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:01.793269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1198/2386] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:23:01 2021] DELETE /identity/v3/users/b6fd88eadf134e8a8a474e598c8c3bf6 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:01.797863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a0d97-b252-4248-954d-d71716ff6ade None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:01.798178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a0d97-b252-4248-954d-d71716ff6ade None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:01.798453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a0d97-b252-4248-954d-d71716ff6ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:01.816226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ef0a0d97-b252-4248-954d-d71716ff6ade None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:01.817471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ef0a0d97-b252-4248-954d-d71716ff6ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:01.873529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1189/2387] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:23:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:01.884220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:01.885655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:01.940906 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1626b50-dcea-49dc-ac52-05a5907ea515 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:01.945904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26a2a85-09c3-4ca4-a048-01fabc973494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:01.946584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a2a85-09c3-4ca4-a048-01fabc973494 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:01.946863 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a2a85-09c3-4ca4-a048-01fabc973494 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:01.947134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26a2a85-09c3-4ca4-a048-01fabc973494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:01.956020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a2a85-09c3-4ca4-a048-01fabc973494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:01.958458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26a2a85-09c3-4ca4-a048-01fabc973494 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:01.967736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1199/2388] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:23:01 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:23:02.298688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a0d97-b252-4248-954d-d71716ff6ade None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:23:02.300253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ef0a0d97-b252-4248-954d-d71716ff6ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:02.318909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a0d97-b252-4248-954d-d71716ff6ade None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:23:02.325161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:23:02.325923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:02.326227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:02.326496 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] PATH_INFO: `/v3/projects/62ba4e49116c4783802852db9449300f` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:02.327758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=62ba4e49116c4783802852db9449300f)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:23:02.329628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:23:02.482554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62ba4e49116c4783802852db9449300f', 'request_id': 'req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:02.488917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62ba4e49116c4783802852db9449300f', 'request_id': 'req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:02.494595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62ba4e49116c4783802852db9449300f', 'request_id': 'req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:02.659707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] The token cache is being invalidate because project 62ba4e49116c4783802852db9449300f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:23:02.660649 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:02.661264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f46cb515-ccb8-48cb-bd67-9d59e5a59f0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:23:02.662834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1190/2389] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:23:02 2021] DELETE /identity/v3/projects/62ba4e49116c4783802852db9449300f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:23:15.610091 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a01d32-2535-4398-a20e-8dcc67a76c71 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:15.610603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a01d32-2535-4398-a20e-8dcc67a76c71 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:15.610699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a01d32-2535-4398-a20e-8dcc67a76c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:15.627305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-74a01d32-2535-4398-a20e-8dcc67a76c71 None None] MFA Rules not processed for user `b35bfb19e59d4f3aa015cb094b2236fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:15.628519 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-74a01d32-2535-4398-a20e-8dcc67a76c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:15.681981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1200/2390] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:23:15 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:30.723065 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73be26-e707-4c1b-95b5-8e4007e92029 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:30.723704 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73be26-e707-4c1b-95b5-8e4007e92029 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:30.723969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc73be26-e707-4c1b-95b5-8e4007e92029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:30.741625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-dc73be26-e707-4c1b-95b5-8e4007e92029 None None] MFA Rules not processed for user `ff1374f1e319492da48f32b53c91f3ac`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:30.742853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dc73be26-e707-4c1b-95b5-8e4007e92029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:30.796582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1191/2391] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:23:30 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:23:31.030529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728410ec-278e-4622-b5eb-d70adfd78923 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:31.031060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728410ec-278e-4622-b5eb-d70adfd78923 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:31.031060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728410ec-278e-4622-b5eb-d70adfd78923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:31.048660 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-728410ec-278e-4622-b5eb-d70adfd78923 None None] MFA Rules not processed for user `b35bfb19e59d4f3aa015cb094b2236fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:31.050549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-728410ec-278e-4622-b5eb-d70adfd78923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:31.057853 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1201/2392] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:23:31 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:23:55.157076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3a8d-aba4-4abf-be13-c996046868f8 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:23:55.157593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3a8d-aba4-4abf-be13-c996046868f8 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:23:55.157593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed3a8d-aba4-4abf-be13-c996046868f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:23:55.175686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-97ed3a8d-aba4-4abf-be13-c996046868f8 None None] MFA Rules not processed for user `e97b78644a8046da928880c62b18253d`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:23:55.176886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-97ed3a8d-aba4-4abf-be13-c996046868f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:23:55.229289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1192/2393] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:23:55 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:00.752597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66cae1-ef42-44df-921e-77ff4e57bcc0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:00.755604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66cae1-ef42-44df-921e-77ff4e57bcc0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:00.755604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f66cae1-ef42-44df-921e-77ff4e57bcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:00.771836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9f66cae1-ef42-44df-921e-77ff4e57bcc0 None None] MFA Rules not processed for user `b35bfb19e59d4f3aa015cb094b2236fd`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:00.773024 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9f66cae1-ef42-44df-921e-77ff4e57bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:00.779814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1202/2394] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:00 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:05.406527 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db17e57-1457-48d2-9fd1-143f4210a9d1 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.407020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db17e57-1457-48d2-9fd1-143f4210a9d1 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.407210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db17e57-1457-48d2-9fd1-143f4210a9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.425631 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-5db17e57-1457-48d2-9fd1-143f4210a9d1 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:05.426880 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5db17e57-1457-48d2-9fd1-143f4210a9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:05.492355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1193/2395] 10.222.0.32 () {58 vars in 967 bytes} [Wed Oct 27 01:24:05 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:05.732635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66cae1-ef42-44df-921e-77ff4e57bcc0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:05.734146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9f66cae1-ef42-44df-921e-77ff4e57bcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:05.803226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f66cae1-ef42-44df-921e-77ff4e57bcc0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:05.808278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41a455-fa3b-45e8-9c56-9f80a07b24ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:05.808917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41a455-fa3b-45e8-9c56-9f80a07b24ce service swift] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:05.809225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41a455-fa3b-45e8-9c56-9f80a07b24ce service swift] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:05.809494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41a455-fa3b-45e8-9c56-9f80a07b24ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:05.817975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41a455-fa3b-45e8-9c56-9f80a07b24ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:05.819629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41a455-fa3b-45e8-9c56-9f80a07b24ce service swift] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:05.827901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1203/2396] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:24:05 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:08.302790 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db17e57-1457-48d2-9fd1-143f4210a9d1 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:08.304304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5db17e57-1457-48d2-9fd1-143f4210a9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:08.360535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db17e57-1457-48d2-9fd1-143f4210a9d1 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:08.364857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:08.365577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:08.370609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:08.370609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:08.370609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:08.445375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:08.447182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:08.460779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1194/2397] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:08 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:08.677671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41a455-fa3b-45e8-9c56-9f80a07b24ce service swift] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:08.686990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41a455-fa3b-45e8-9c56-9f80a07b24ce service swift] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:08.691385 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc4938-82c9-4b22-b135-7484e1bfc317 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:08.692019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc4938-82c9-4b22-b135-7484e1bfc317 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:08.692330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc4938-82c9-4b22-b135-7484e1bfc317 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:08.692602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc4938-82c9-4b22-b135-7484e1bfc317 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:08.694396 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d6dc4938-82c9-4b22-b135-7484e1bfc317 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:08.710616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc4938-82c9-4b22-b135-7484e1bfc317 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:08.710616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc4938-82c9-4b22-b135-7484e1bfc317 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:08.720390 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1204/2398] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:08 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:15.380084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:15.381545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:15.445594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b64fec-6539-4ede-84ff-3ed28518585e service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:15.449994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:15.450876 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:15.451154 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:15.451425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] PATH_INFO: `/v3/users/d9f2d198479f41a5aede9109c9ae90a9` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:15.452625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9f2d198479f41a5aede9109c9ae90a9)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:15.454567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:15.654343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9f2d198479f41a5aede9109c9ae90a9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:15.666518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9f2d198479f41a5aede9109c9ae90a9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:15.673640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9f2d198479f41a5aede9109c9ae90a9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:15.674349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9f2d198479f41a5aede9109c9ae90a9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:15.788805 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9f2d198479f41a5aede9109c9ae90a9'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:15.799145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1195/2399] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:24:15 2021] DELETE /identity/v3/users/d9f2d198479f41a5aede9109c9ae90a9 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:16.082009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc4938-82c9-4b22-b135-7484e1bfc317 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:16.093627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc4938-82c9-4b22-b135-7484e1bfc317 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:16.148743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:16.149596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:16.149877 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:16.150184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] PATH_INFO: `/v3/projects/5e37607855ec49b6af8f28274acba57b` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:16.151453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e37607855ec49b6af8f28274acba57b)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:16.153365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:16.297060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e37607855ec49b6af8f28274acba57b', 'request_id': 'req-7f058fc9-4072-4668-98c4-1caaa79a4c3f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.303447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e37607855ec49b6af8f28274acba57b', 'request_id': 'req-7f058fc9-4072-4668-98c4-1caaa79a4c3f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.308683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e37607855ec49b6af8f28274acba57b', 'request_id': 'req-7f058fc9-4072-4668-98c4-1caaa79a4c3f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.457882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] The token cache is being invalidate because project 5e37607855ec49b6af8f28274acba57b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:16.458227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.458842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.463289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1205/2400] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:24:16 2021] DELETE /identity/v3/projects/5e37607855ec49b6af8f28274acba57b => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:16.464481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:16.465993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:16.479721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41b9ab-856d-451e-95ac-73b9444e0616 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:16.537849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:16.538739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:16.539136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:16.539415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] PATH_INFO: `/v3/users/256bcf05d5f841a381f7af77eaa7d2e5` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:16.540690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=256bcf05d5f841a381f7af77eaa7d2e5)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:16.542580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:16.735165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '256bcf05d5f841a381f7af77eaa7d2e5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.746614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '256bcf05d5f841a381f7af77eaa7d2e5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.753426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '256bcf05d5f841a381f7af77eaa7d2e5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.754173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '256bcf05d5f841a381f7af77eaa7d2e5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.890908 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-997422b2-78ec-443e-9a37-6c139a2fdb79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '256bcf05d5f841a381f7af77eaa7d2e5'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:16.898309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1196/2401] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:24:16 2021] DELETE /identity/v3/users/256bcf05d5f841a381f7af77eaa7d2e5 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:17.161867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:17.163303 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:17.177261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f058fc9-4072-4668-98c4-1caaa79a4c3f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:17.239494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:17.240400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:17.240674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:17.240942 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] PATH_INFO: `/v3/projects/10960a4e2cc44f2a950118db5f195c6a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:17.242162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10960a4e2cc44f2a950118db5f195c6a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:17.244056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:17.383773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10960a4e2cc44f2a950118db5f195c6a', 'request_id': 'req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.389678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10960a4e2cc44f2a950118db5f195c6a', 'request_id': 'req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.395499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10960a4e2cc44f2a950118db5f195c6a', 'request_id': 'req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.565248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] The token cache is being invalidate because project 10960a4e2cc44f2a950118db5f195c6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:17.565532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.566166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d6bbe201-54cb-4fe1-b2cd-0064c8d4c570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:17.569708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1206/2402] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:24:17 2021] DELETE /identity/v3/projects/10960a4e2cc44f2a950118db5f195c6a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:17.574331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cea3c0-5e18-4f8d-94a0-742d771982ff None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:17.574795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cea3c0-5e18-4f8d-94a0-742d771982ff None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:17.574893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cea3c0-5e18-4f8d-94a0-742d771982ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:17.593303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-30cea3c0-5e18-4f8d-94a0-742d771982ff None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:17.594569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-30cea3c0-5e18-4f8d-94a0-742d771982ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:17.654854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1197/2403] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:17.663529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36dfbb-ea3c-4321-87e1-74ae5dbc4b51 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:17.663917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36dfbb-ea3c-4321-87e1-74ae5dbc4b51 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:17.664192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36dfbb-ea3c-4321-87e1-74ae5dbc4b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:17.682298 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5b36dfbb-ea3c-4321-87e1-74ae5dbc4b51 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:17.683484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5b36dfbb-ea3c-4321-87e1-74ae5dbc4b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:17.691968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1207/2404] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:17 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:17.696409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cea3c0-5e18-4f8d-94a0-742d771982ff None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:17.706373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cea3c0-5e18-4f8d-94a0-742d771982ff None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:17.710949 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67213e8-72d8-4b96-b916-f20c61ef7abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:17.711598 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67213e8-72d8-4b96-b916-f20c61ef7abd admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:17.711863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67213e8-72d8-4b96-b916-f20c61ef7abd admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:17.712134 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67213e8-72d8-4b96-b916-f20c61ef7abd admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:17.712859 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67213e8-72d8-4b96-b916-f20c61ef7abd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:17.713160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67213e8-72d8-4b96-b916-f20c61ef7abd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:17.714766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67213e8-72d8-4b96-b916-f20c61ef7abd admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:17.726961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1198/2405] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:24:17 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:24:17.731383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36dfbb-ea3c-4321-87e1-74ae5dbc4b51 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:17.740947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36dfbb-ea3c-4321-87e1-74ae5dbc4b51 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:17.745786 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c81e5-5b1c-477f-a3e2-30de3dc49778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:17.746658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c81e5-5b1c-477f-a3e2-30de3dc49778 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:17.747389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c81e5-5b1c-477f-a3e2-30de3dc49778 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:17.747389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c81e5-5b1c-477f-a3e2-30de3dc49778 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:17.747988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c81e5-5b1c-477f-a3e2-30de3dc49778 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:17.749849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c81e5-5b1c-477f-a3e2-30de3dc49778 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:17.831695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1208/2406] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:24:17 2021] POST /identity/v3/projects => generated 371 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:17.835923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67213e8-72d8-4b96-b916-f20c61ef7abd admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:17.845526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67213e8-72d8-4b96-b916-f20c61ef7abd admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:17.898576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3036-b1f5-4c5e-a6d0-18390b67a1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:17.899228 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3036-b1f5-4c5e-a6d0-18390b67a1c8 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:17.899510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3036-b1f5-4c5e-a6d0-18390b67a1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:17.899793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a3036-b1f5-4c5e-a6d0-18390b67a1c8 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:17.900483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a3036-b1f5-4c5e-a6d0-18390b67a1c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:17.902384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a3036-b1f5-4c5e-a6d0-18390b67a1c8 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:18.003107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1199/2407] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:24:17 2021] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:18.011050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c81e5-5b1c-477f-a3e2-30de3dc49778 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:18.021584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c81e5-5b1c-477f-a3e2-30de3dc49778 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:18.026347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241c9ec-2fab-4035-8feb-42fcd7dd41ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:18.026996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241c9ec-2fab-4035-8feb-42fcd7dd41ef admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:18.027270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241c9ec-2fab-4035-8feb-42fcd7dd41ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:18.027544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9241c9ec-2fab-4035-8feb-42fcd7dd41ef admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:18.028280 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241c9ec-2fab-4035-8feb-42fcd7dd41ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:18.029832 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9241c9ec-2fab-4035-8feb-42fcd7dd41ef admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:18.042894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1209/2408] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:24:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:18.046897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3036-b1f5-4c5e-a6d0-18390b67a1c8 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:18.056850 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a3036-b1f5-4c5e-a6d0-18390b67a1c8 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:18.061388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f722ab51-e682-4e4b-8619-244a837df672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:18.062083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722ab51-e682-4e4b-8619-244a837df672 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:18.062339 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722ab51-e682-4e4b-8619-244a837df672 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:18.062608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f722ab51-e682-4e4b-8619-244a837df672 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:18.063368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722ab51-e682-4e4b-8619-244a837df672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:18.066035 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f722ab51-e682-4e4b-8619-244a837df672 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:18.076031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1200/2409] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:24:18 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:24:18.080867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241c9ec-2fab-4035-8feb-42fcd7dd41ef admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:18.090992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9241c9ec-2fab-4035-8feb-42fcd7dd41ef admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:18.096554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f44a6-98a4-4ee0-ab01-9a85a4f5819b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:18.097451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f44a6-98a4-4ee0-ab01-9a85a4f5819b admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:18.097728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f44a6-98a4-4ee0-ab01-9a85a4f5819b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:18.097996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f44a6-98a4-4ee0-ab01-9a85a4f5819b admin admin] PATH_INFO: `/v3/projects/71d6d08d1ae14a628663fb4124cfccc2/users/af5e8cd9e794460f805ce9e5b70edd32/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:18.112938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f44a6-98a4-4ee0-ab01-9a85a4f5819b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d6d08d1ae14a628663fb4124cfccc2, user_id=af5e8cd9e794460f805ce9e5b70edd32, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:18.117501 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f44a6-98a4-4ee0-ab01-9a85a4f5819b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:18.200416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1210/2410] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:24:18 2021] PUT /identity/v3/projects/71d6d08d1ae14a628663fb4124cfccc2/users/af5e8cd9e794460f805ce9e5b70edd32/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:18.211407 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c0c9-99dc-4644-8680-c9f786e247d6 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:18.211692 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c0c9-99dc-4644-8680-c9f786e247d6 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:18.212167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc9c0c9-99dc-4644-8680-c9f786e247d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:18.230395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-5bc9c0c9-99dc-4644-8680-c9f786e247d6 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:18.231793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5bc9c0c9-99dc-4644-8680-c9f786e247d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.291719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1201/2411] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:18.307898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f44a6-98a4-4ee0-ab01-9a85a4f5819b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:18.307898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-719f44a6-98a4-4ee0-ab01-9a85a4f5819b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.360924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f44a6-98a4-4ee0-ab01-9a85a4f5819b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:18.364665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7fce7-e034-4edb-a77b-8cabcd15839c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:18.365302 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7fce7-e034-4edb-a77b-8cabcd15839c service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:18.365585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7fce7-e034-4edb-a77b-8cabcd15839c service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:18.365861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7fce7-e034-4edb-a77b-8cabcd15839c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:18.374717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7fce7-e034-4edb-a77b-8cabcd15839c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:18.376823 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7fce7-e034-4edb-a77b-8cabcd15839c service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:18.386246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1211/2412] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:18 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:18.705808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9c0c9-99dc-4644-8680-c9f786e247d6 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:18.707215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5bc9c0c9-99dc-4644-8680-c9f786e247d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.781855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc9c0c9-99dc-4644-8680-c9f786e247d6 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:18.787803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f3261a-71f5-4582-a7d4-ff927b8274b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:18.788437 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3261a-71f5-4582-a7d4-ff927b8274b7 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:18.788712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3261a-71f5-4582-a7d4-ff927b8274b7 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:18.789102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f3261a-71f5-4582-a7d4-ff927b8274b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:18.790868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-36f3261a-71f5-4582-a7d4-ff927b8274b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:18.849073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3261a-71f5-4582-a7d4-ff927b8274b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:18.850685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f3261a-71f5-4582-a7d4-ff927b8274b7 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:18.859877 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1202/2413] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:18 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:19.190637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7fce7-e034-4edb-a77b-8cabcd15839c service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:19.191969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c0b7fce7-e034-4edb-a77b-8cabcd15839c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:19.207333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7fce7-e034-4edb-a77b-8cabcd15839c service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:19.212752 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3850f5e-719d-4938-91f8-15d28fe2335c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:19.213425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3850f5e-719d-4938-91f8-15d28fe2335c service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:19.213762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3850f5e-719d-4938-91f8-15d28fe2335c service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:19.214061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3850f5e-719d-4938-91f8-15d28fe2335c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:19.215828 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d3850f5e-719d-4938-91f8-15d28fe2335c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:19.277274 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3850f5e-719d-4938-91f8-15d28fe2335c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:19.279060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3850f5e-719d-4938-91f8-15d28fe2335c service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:19.288937 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1212/2414] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:19 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:24.163095 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bdea8-ded1-4d9a-a8c6-d04badc6bcba None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.163621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bdea8-ded1-4d9a-a8c6-d04badc6bcba None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.163621 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bdea8-ded1-4d9a-a8c6-d04badc6bcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.191785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f40bdea8-ded1-4d9a-a8c6-d04badc6bcba None None] MFA Rules not processed for user `af5e8cd9e794460f805ce9e5b70edd32`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:24.192992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f40bdea8-ded1-4d9a-a8c6-d04badc6bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:24.266099 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1203/2415] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:24 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:24.271005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3850f5e-719d-4938-91f8-15d28fe2335c service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.281532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3850f5e-719d-4938-91f8-15d28fe2335c service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.286509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0fd52-79a7-45ca-b824-19b8487f563a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.287319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0fd52-79a7-45ca-b824-19b8487f563a admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.287603 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0fd52-79a7-45ca-b824-19b8487f563a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.287870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0fd52-79a7-45ca-b824-19b8487f563a admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.288572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0fd52-79a7-45ca-b824-19b8487f563a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.290515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0fd52-79a7-45ca-b824-19b8487f563a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.401964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1213/2416] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:24:24 2021] POST /identity/v3/projects => generated 371 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:24.406231 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bdea8-ded1-4d9a-a8c6-d04badc6bcba None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.419033 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40bdea8-ded1-4d9a-a8c6-d04badc6bcba None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.478221 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77315a09-9811-44da-897c-1d5f9a499cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.478930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77315a09-9811-44da-897c-1d5f9a499cae admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.479210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77315a09-9811-44da-897c-1d5f9a499cae admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.479482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77315a09-9811-44da-897c-1d5f9a499cae admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.480190 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77315a09-9811-44da-897c-1d5f9a499cae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.482125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77315a09-9811-44da-897c-1d5f9a499cae admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.560422 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1204/2417] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:24:24 2021] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:24.565126 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0fd52-79a7-45ca-b824-19b8487f563a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.576768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0fd52-79a7-45ca-b824-19b8487f563a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.582238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1e6ca-b40a-433e-82f6-7921658a4fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.582904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1e6ca-b40a-433e-82f6-7921658a4fec admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.583182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1e6ca-b40a-433e-82f6-7921658a4fec admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.583456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e1e6ca-b40a-433e-82f6-7921658a4fec admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.584224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1e6ca-b40a-433e-82f6-7921658a4fec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.585794 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e1e6ca-b40a-433e-82f6-7921658a4fec admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.596921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1214/2418] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:24:24 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:24.602644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77315a09-9811-44da-897c-1d5f9a499cae admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.613042 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77315a09-9811-44da-897c-1d5f9a499cae admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.618373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01532a2b-2c3a-4c7f-8649-467bf458cd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.619400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532a2b-2c3a-4c7f-8649-467bf458cd6d admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.619773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532a2b-2c3a-4c7f-8649-467bf458cd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.620144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01532a2b-2c3a-4c7f-8649-467bf458cd6d admin admin] PATH_INFO: `/v3/projects/09ce70adca1d41049501286314f0bd94/users/939ef019d4204a64bb8273145e6a8fa1/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.637214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532a2b-2c3a-4c7f-8649-467bf458cd6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ce70adca1d41049501286314f0bd94, user_id=939ef019d4204a64bb8273145e6a8fa1, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.639869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01532a2b-2c3a-4c7f-8649-467bf458cd6d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.732128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1205/2419] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:24:24 2021] PUT /identity/v3/projects/09ce70adca1d41049501286314f0bd94/users/939ef019d4204a64bb8273145e6a8fa1/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:24.739058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1e6ca-b40a-433e-82f6-7921658a4fec admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.748674 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e1e6ca-b40a-433e-82f6-7921658a4fec admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.803653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bff519-51a3-42df-bad7-ec435a779b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.804231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bff519-51a3-42df-bad7-ec435a779b9d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.804507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bff519-51a3-42df-bad7-ec435a779b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.804999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bff519-51a3-42df-bad7-ec435a779b9d admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.805720 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bff519-51a3-42df-bad7-ec435a779b9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.807333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bff519-51a3-42df-bad7-ec435a779b9d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.817974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1215/2420] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:24:24 2021] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:24.822256 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01532a2b-2c3a-4c7f-8649-467bf458cd6d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:24.833252 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01532a2b-2c3a-4c7f-8649-467bf458cd6d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:24.838125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b8e5-5fce-422b-926b-eaaa1af00df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:24.839129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b8e5-5fce-422b-926b-eaaa1af00df4 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:24.839360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b8e5-5fce-422b-926b-eaaa1af00df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:24.839684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311b8e5-5fce-422b-926b-eaaa1af00df4 admin admin] PATH_INFO: `/v3/projects/09ce70adca1d41049501286314f0bd94/users/939ef019d4204a64bb8273145e6a8fa1/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:24.841667 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311b8e5-5fce-422b-926b-eaaa1af00df4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09ce70adca1d41049501286314f0bd94, user_id=939ef019d4204a64bb8273145e6a8fa1, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:24.844393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311b8e5-5fce-422b-926b-eaaa1af00df4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:24.855636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1206/2421] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:24:24 2021] PUT /identity/v3/projects/09ce70adca1d41049501286314f0bd94/users/939ef019d4204a64bb8273145e6a8fa1/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:24:30.995284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0031-b273-41f7-9cd7-8830b5112e9c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:30.995774 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0031-b273-41f7-9cd7-8830b5112e9c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:30.995871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c0031-b273-41f7-9cd7-8830b5112e9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.041292 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-043c0031-b273-41f7-9cd7-8830b5112e9c None None] MFA Rules not processed for user `939ef019d4204a64bb8273145e6a8fa1`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:31.042536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-043c0031-b273-41f7-9cd7-8830b5112e9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:31.115371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1216/2422] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:30 2021] POST /identity/v3/auth/tokens => generated 3458 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:31.130874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b8e5-5fce-422b-926b-eaaa1af00df4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:31.202268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311b8e5-5fce-422b-926b-eaaa1af00df4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:31.207773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca04a1-caa8-4c8f-a003-3868e1c60632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:31.208459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca04a1-caa8-4c8f-a003-3868e1c60632 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:31.208737 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca04a1-caa8-4c8f-a003-3868e1c60632 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:31.209012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca04a1-caa8-4c8f-a003-3868e1c60632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:31.266593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca04a1-caa8-4c8f-a003-3868e1c60632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:31.268401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ca04a1-caa8-4c8f-a003-3868e1c60632 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:31.283257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1207/2423] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:31 2021] GET /identity/v3/auth/tokens => generated 3391 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:34.319187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcce33f-c647-4187-bb11-8cc92cb86543 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:34.319690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcce33f-c647-4187-bb11-8cc92cb86543 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:34.319985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcce33f-c647-4187-bb11-8cc92cb86543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:34.341459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5dcce33f-c647-4187-bb11-8cc92cb86543 None None] MFA Rules not processed for user `af5e8cd9e794460f805ce9e5b70edd32`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:34.344016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5dcce33f-c647-4187-bb11-8cc92cb86543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:34.377880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1217/2424] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:34 2021] POST /identity/v3/auth/tokens => generated 3391 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:40.099950 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca04a1-caa8-4c8f-a003-3868e1c60632 service nova] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:40.111483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca04a1-caa8-4c8f-a003-3868e1c60632 service nova] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:40.117196 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:40.117855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:40.118168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:40.118435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:40.120210 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:40.134862 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:40.136493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:40.152775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1208/2425] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:40 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:51.849593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91887-e146-458e-aea9-13e9f7b1624f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:51.850118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91887-e146-458e-aea9-13e9f7b1624f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:51.850221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef91887-e146-458e-aea9-13e9f7b1624f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:51.869900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-cef91887-e146-458e-aea9-13e9f7b1624f None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:51.871156 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-cef91887-e146-458e-aea9-13e9f7b1624f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:51.929057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1218/2426] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:24:51 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:51.942238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:51.943671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.017815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6404962-e681-4d66-a2d5-dc9dee57c758 service nova] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:52.023870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31588-ca3a-477c-bea4-bcbdaaf08cdf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:52.024633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31588-ca3a-477c-bea4-bcbdaaf08cdf service swift] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.024971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31588-ca3a-477c-bea4-bcbdaaf08cdf service swift] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.025304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee31588-ca3a-477c-bea4-bcbdaaf08cdf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.035296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee31588-ca3a-477c-bea4-bcbdaaf08cdf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:52.037206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee31588-ca3a-477c-bea4-bcbdaaf08cdf service swift] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:52.045663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1209/2427] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:24:51 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:24:52.095656 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef91887-e146-458e-aea9-13e9f7b1624f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:52.109157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef91887-e146-458e-aea9-13e9f7b1624f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:52.115223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea37a-4a0a-49b8-bdc1-6e8182386517 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:52.115857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea37a-4a0a-49b8-bdc1-6e8182386517 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:52.117244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea37a-4a0a-49b8-bdc1-6e8182386517 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:52.117244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fea37a-4a0a-49b8-bdc1-6e8182386517 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:52.118357 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-08fea37a-4a0a-49b8-bdc1-6e8182386517 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:52.130627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fea37a-4a0a-49b8-bdc1-6e8182386517 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:52.132209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fea37a-4a0a-49b8-bdc1-6e8182386517 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:52.143488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1219/2428] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:52 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:54.102483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31588-ca3a-477c-bea4-bcbdaaf08cdf service swift] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.103913 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5ee31588-ca3a-477c-bea4-bcbdaaf08cdf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:54.172397 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee31588-ca3a-477c-bea4-bcbdaaf08cdf service swift] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.178843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.179928 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.180406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.180828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] PATH_INFO: `/v3/users/b35bfb19e59d4f3aa015cb094b2236fd` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.182247 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35bfb19e59d4f3aa015cb094b2236fd)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.184323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:54.397639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35bfb19e59d4f3aa015cb094b2236fd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:54.412261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35bfb19e59d4f3aa015cb094b2236fd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:54.419389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35bfb19e59d4f3aa015cb094b2236fd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:54.420448 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35bfb19e59d4f3aa015cb094b2236fd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:54.485039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-20129193-18b6-417f-ad3f-3badbbca7a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35bfb19e59d4f3aa015cb094b2236fd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:54.492761 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1210/2429] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:24:54 2021] DELETE /identity/v3/users/b35bfb19e59d4f3aa015cb094b2236fd => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:54.740108 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea37a-4a0a-49b8-bdc1-6e8182386517 service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:54.756475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fea37a-4a0a-49b8-bdc1-6e8182386517 service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:54.865319 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:54.866331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:54.871476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:54.871476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] PATH_INFO: `/v3/projects/0aca48cc13184200acc3cee83bf4265c` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:54.871476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aca48cc13184200acc3cee83bf4265c)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:54.871476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:55.001784 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aca48cc13184200acc3cee83bf4265c', 'request_id': 'req-ea6fc060-faf6-4688-ace8-5b06421e9ed9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:55.008291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aca48cc13184200acc3cee83bf4265c', 'request_id': 'req-ea6fc060-faf6-4688-ace8-5b06421e9ed9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:55.014346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aca48cc13184200acc3cee83bf4265c', 'request_id': 'req-ea6fc060-faf6-4688-ace8-5b06421e9ed9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:55.090336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] The token cache is being invalidate because project 0aca48cc13184200acc3cee83bf4265c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:24:55.090695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:55.091432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ea6fc060-faf6-4688-ace8-5b06421e9ed9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:24:55.093084 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1220/2430] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:24:54 2021] DELETE /identity/v3/projects/0aca48cc13184200acc3cee83bf4265c => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:55.099686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecb465-5938-493a-a7d5-c0f1b2e4043f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.099978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecb465-5938-493a-a7d5-c0f1b2e4043f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.100309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecb465-5938-493a-a7d5-c0f1b2e4043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.120717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-80ecb465-5938-493a-a7d5-c0f1b2e4043f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:55.121986 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-80ecb465-5938-493a-a7d5-c0f1b2e4043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:55.190180 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1211/2431] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:55.197135 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a45e-2ad6-4edc-92f9-b904048963ea None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.197505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a45e-2ad6-4edc-92f9-b904048963ea None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.197875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b2a45e-2ad6-4edc-92f9-b904048963ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.219181 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f6b2a45e-2ad6-4edc-92f9-b904048963ea None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:55.220653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f6b2a45e-2ad6-4edc-92f9-b904048963ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:55.229234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1221/2432] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:55 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:55.233573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecb465-5938-493a-a7d5-c0f1b2e4043f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:55.245819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecb465-5938-493a-a7d5-c0f1b2e4043f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:55.253964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07755e7a-307d-4bd3-9da9-4616fe59c2a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:55.253964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07755e7a-307d-4bd3-9da9-4616fe59c2a4 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.253964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07755e7a-307d-4bd3-9da9-4616fe59c2a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.253964 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07755e7a-307d-4bd3-9da9-4616fe59c2a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.254377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07755e7a-307d-4bd3-9da9-4616fe59c2a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:24:55.254377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07755e7a-307d-4bd3-9da9-4616fe59c2a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:55.255717 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07755e7a-307d-4bd3-9da9-4616fe59c2a4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:55.270067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1212/2433] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:24:55 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:24:55.273773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a45e-2ad6-4edc-92f9-b904048963ea None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:55.284161 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b2a45e-2ad6-4edc-92f9-b904048963ea None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:55.293140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53277cdf-3f4b-4903-8659-7f3bd46683e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:55.293803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53277cdf-3f4b-4903-8659-7f3bd46683e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.294110 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53277cdf-3f4b-4903-8659-7f3bd46683e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.294393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53277cdf-3f4b-4903-8659-7f3bd46683e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.295135 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53277cdf-3f4b-4903-8659-7f3bd46683e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:55.298086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53277cdf-3f4b-4903-8659-7f3bd46683e1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:55.409830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1222/2434] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:24:55 2021] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:55.414227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07755e7a-307d-4bd3-9da9-4616fe59c2a4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:55.430915 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07755e7a-307d-4bd3-9da9-4616fe59c2a4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:55.512608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06aa83-031f-421c-8661-6121278af2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:55.513351 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06aa83-031f-421c-8661-6121278af2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.513633 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06aa83-031f-421c-8661-6121278af2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.513913 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a06aa83-031f-421c-8661-6121278af2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.514794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06aa83-031f-421c-8661-6121278af2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:55.516900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a06aa83-031f-421c-8661-6121278af2d4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:55.623016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1213/2435] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:24:55 2021] POST /identity/v3/users => generated 285 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:24:55.627419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53277cdf-3f4b-4903-8659-7f3bd46683e1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:55.638781 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53277cdf-3f4b-4903-8659-7f3bd46683e1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:55.644412 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969421a-5b4e-4ee5-92d1-091368802feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:55.645145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969421a-5b4e-4ee5-92d1-091368802feb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.645491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969421a-5b4e-4ee5-92d1-091368802feb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.646081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c969421a-5b4e-4ee5-92d1-091368802feb admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.646969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969421a-5b4e-4ee5-92d1-091368802feb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:55.648607 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c969421a-5b4e-4ee5-92d1-091368802feb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:55.660415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1223/2436] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:24:55 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:55.664261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06aa83-031f-421c-8661-6121278af2d4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:55.675489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a06aa83-031f-421c-8661-6121278af2d4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:55.680490 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd026ccf-26cf-4413-bf01-841bad09e74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:55.681327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd026ccf-26cf-4413-bf01-841bad09e74e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.681614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd026ccf-26cf-4413-bf01-841bad09e74e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.681886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd026ccf-26cf-4413-bf01-841bad09e74e admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.682671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd026ccf-26cf-4413-bf01-841bad09e74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:55.684308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd026ccf-26cf-4413-bf01-841bad09e74e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:55.695762 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1214/2437] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:24:55 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:24:55.699859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969421a-5b4e-4ee5-92d1-091368802feb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:55.711125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c969421a-5b4e-4ee5-92d1-091368802feb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:55.715896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b44eaf-c52c-4246-9aff-738d38adfb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:55.716798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b44eaf-c52c-4246-9aff-738d38adfb38 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.717105 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b44eaf-c52c-4246-9aff-738d38adfb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.717383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b44eaf-c52c-4246-9aff-738d38adfb38 admin admin] PATH_INFO: `/v3/projects/dc6a414d77a84119a89a46b9d535af6a/users/12d80b995965488e91ca3941eaa0cb3d/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.734699 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b44eaf-c52c-4246-9aff-738d38adfb38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6a414d77a84119a89a46b9d535af6a, user_id=12d80b995965488e91ca3941eaa0cb3d, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:55.737407 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b44eaf-c52c-4246-9aff-738d38adfb38 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:55.814155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1224/2438] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:24:55 2021] PUT /identity/v3/projects/dc6a414d77a84119a89a46b9d535af6a/users/12d80b995965488e91ca3941eaa0cb3d/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:24:55.828747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d4b1-a57d-4c53-bcaa-a5a884675cae None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:55.829033 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d4b1-a57d-4c53-bcaa-a5a884675cae None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:55.829307 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527d4b1-a57d-4c53-bcaa-a5a884675cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:55.877297 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c527d4b1-a57d-4c53-bcaa-a5a884675cae None None] MFA Rules not processed for user `12d80b995965488e91ca3941eaa0cb3d`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:24:55.878585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c527d4b1-a57d-4c53-bcaa-a5a884675cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:55.967789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1215/2439] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:24:55 2021] POST /identity/v3/auth/tokens => generated 3389 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:24:56.044938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b44eaf-c52c-4246-9aff-738d38adfb38 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:56.046794 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c8b44eaf-c52c-4246-9aff-738d38adfb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:56.121061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b44eaf-c52c-4246-9aff-738d38adfb38 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:56.134549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ad2c4-fb3b-4c23-99b2-503243bd84bb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:56.135253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ad2c4-fb3b-4c23-99b2-503243bd84bb service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:56.135533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ad2c4-fb3b-4c23-99b2-503243bd84bb service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:56.135805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9ad2c4-fb3b-4c23-99b2-503243bd84bb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:56.145394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ad2c4-fb3b-4c23-99b2-503243bd84bb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:56.146998 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9ad2c4-fb3b-4c23-99b2-503243bd84bb service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:56.156164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1225/2440] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:56 2021] GET /identity/v3/auth/tokens => generated 3389 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:56.228395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d4b1-a57d-4c53-bcaa-a5a884675cae None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:56.229834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c527d4b1-a57d-4c53-bcaa-a5a884675cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:56.288804 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c527d4b1-a57d-4c53-bcaa-a5a884675cae None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:56.292477 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da29b9a-ace1-4747-b03e-f078c2addc55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:56.293119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da29b9a-ace1-4747-b03e-f078c2addc55 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:56.293398 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da29b9a-ace1-4747-b03e-f078c2addc55 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:56.293671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da29b9a-ace1-4747-b03e-f078c2addc55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:56.295629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1da29b9a-ace1-4747-b03e-f078c2addc55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:56.305632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da29b9a-ace1-4747-b03e-f078c2addc55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:56.307222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da29b9a-ace1-4747-b03e-f078c2addc55 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:56.316094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1216/2441] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:56 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:24:57.166202 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ad2c4-fb3b-4c23-99b2-503243bd84bb service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:24:57.171035 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1b9ad2c4-fb3b-4c23-99b2-503243bd84bb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:57.280032 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9ad2c4-fb3b-4c23-99b2-503243bd84bb service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:24:57.288207 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb59e9c-447f-47e8-990b-aea2b211677c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8df6e02fde834883aef230f31d6ecd94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:24:57.289180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb59e9c-447f-47e8-990b-aea2b211677c service placement] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:24:57.289685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb59e9c-447f-47e8-990b-aea2b211677c service placement] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:24:57.290193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb59e9c-447f-47e8-990b-aea2b211677c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:24:57.292148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1bb59e9c-447f-47e8-990b-aea2b211677c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:24:57.313405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb59e9c-447f-47e8-990b-aea2b211677c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:24:57.313405 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb59e9c-447f-47e8-990b-aea2b211677c service placement] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:24:57.324799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1226/2442] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:24:57 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:00.002449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da29b9a-ace1-4747-b03e-f078c2addc55 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:00.080742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da29b9a-ace1-4747-b03e-f078c2addc55 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:00.086541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:00.087699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:00.088050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:00.088419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] PATH_INFO: `/v3/users/12d80b995965488e91ca3941eaa0cb3d` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:00.089932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12d80b995965488e91ca3941eaa0cb3d)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:00.091923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:00.336924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12d80b995965488e91ca3941eaa0cb3d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:00.356391 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12d80b995965488e91ca3941eaa0cb3d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:00.366731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12d80b995965488e91ca3941eaa0cb3d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:00.368262 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12d80b995965488e91ca3941eaa0cb3d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:00.496359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12d80b995965488e91ca3941eaa0cb3d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:00.503415 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1217/2443] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:25:00 2021] DELETE /identity/v3/users/12d80b995965488e91ca3941eaa0cb3d => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:00.508292 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742558a-f08c-45e3-b9b4-93a651bf164c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:00.508831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742558a-f08c-45e3-b9b4-93a651bf164c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:00.508831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b742558a-f08c-45e3-b9b4-93a651bf164c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:00.527178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b742558a-f08c-45e3-b9b4-93a651bf164c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:00.528508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b742558a-f08c-45e3-b9b4-93a651bf164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:00.658218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1227/2444] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:00 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:00.684209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:00.686537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:00.770752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6501a2-4111-41bb-b8b6-858d874a1a30 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:00.775152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98fa10-14db-4696-b270-be607ad8e568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:00.775849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98fa10-14db-4696-b270-be607ad8e568 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:00.776127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98fa10-14db-4696-b270-be607ad8e568 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:00.776458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98fa10-14db-4696-b270-be607ad8e568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:00.787534 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98fa10-14db-4696-b270-be607ad8e568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:00.788963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98fa10-14db-4696-b270-be607ad8e568 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:00.800350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1218/2445] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:00 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:01.420312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742558a-f08c-45e3-b9b4-93a651bf164c None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:01.422695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b742558a-f08c-45e3-b9b4-93a651bf164c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:01.440487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b742558a-f08c-45e3-b9b4-93a651bf164c None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:01.465736 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:01.467679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.468143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.470086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] PATH_INFO: `/v3/projects/dc6a414d77a84119a89a46b9d535af6a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:01.478922 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6a414d77a84119a89a46b9d535af6a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:01.492147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:01.587208 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98fa10-14db-4696-b270-be607ad8e568 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:01.605003 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98fa10-14db-4696-b270-be607ad8e568 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:01.609984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e34b05-6bdc-433b-9b31-4680862b3401 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:01.611116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34b05-6bdc-433b-9b31-4680862b3401 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.611595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34b05-6bdc-433b-9b31-4680862b3401 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.612057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e34b05-6bdc-433b-9b31-4680862b3401 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:01.618760 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-85e34b05-6bdc-433b-9b31-4680862b3401 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:01.630428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e34b05-6bdc-433b-9b31-4680862b3401 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:01.632991 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e34b05-6bdc-433b-9b31-4680862b3401 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:01.644354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1219/2446] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:01 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:01.676042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6a414d77a84119a89a46b9d535af6a', 'request_id': 'req-ca137aab-ccae-4cc9-9817-bd3f76e3772b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.696146 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6a414d77a84119a89a46b9d535af6a', 'request_id': 'req-ca137aab-ccae-4cc9-9817-bd3f76e3772b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.722941 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6a414d77a84119a89a46b9d535af6a', 'request_id': 'req-ca137aab-ccae-4cc9-9817-bd3f76e3772b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.835230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] The token cache is being invalidate because project dc6a414d77a84119a89a46b9d535af6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:01.835869 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.836978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-ca137aab-ccae-4cc9-9817-bd3f76e3772b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:01.839773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1228/2447] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:25:01 2021] DELETE /identity/v3/projects/dc6a414d77a84119a89a46b9d535af6a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:01.846418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae2b1a-2695-4831-9d54-a662a6fec4df None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.846806 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae2b1a-2695-4831-9d54-a662a6fec4df None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.847253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ae2b1a-2695-4831-9d54-a662a6fec4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:01.879102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-04ae2b1a-2695-4831-9d54-a662a6fec4df None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:01.882513 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-04ae2b1a-2695-4831-9d54-a662a6fec4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:01.975944 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1220/2448] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:01.986145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64661-bec8-4d25-b087-a854fc44a852 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:01.986439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64661-bec8-4d25-b087-a854fc44a852 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:01.986720 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd64661-bec8-4d25-b087-a854fc44a852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.013313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8dd64661-bec8-4d25-b087-a854fc44a852 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:02.014755 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8dd64661-bec8-4d25-b087-a854fc44a852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:02.026538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1229/2449] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:01 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:02.027787 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae2b1a-2695-4831-9d54-a662a6fec4df None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.044709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ae2b1a-2695-4831-9d54-a662a6fec4df None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.053161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4295-466c-4681-9d2b-92eb0cd42d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.053842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4295-466c-4681-9d2b-92eb0cd42d33 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.055152 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4295-466c-4681-9d2b-92eb0cd42d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.055498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb4295-466c-4681-9d2b-92eb0cd42d33 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.056778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4295-466c-4681-9d2b-92eb0cd42d33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:02.057085 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4295-466c-4681-9d2b-92eb0cd42d33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.059969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb4295-466c-4681-9d2b-92eb0cd42d33 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.081165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1221/2450] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:25:02 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:02.085526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64661-bec8-4d25-b087-a854fc44a852 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.096191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd64661-bec8-4d25-b087-a854fc44a852 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.104553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517c708-74ac-4ea4-9bf3-0e667a350a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.109641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517c708-74ac-4ea4-9bf3-0e667a350a24 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.109641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517c708-74ac-4ea4-9bf3-0e667a350a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.109641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c517c708-74ac-4ea4-9bf3-0e667a350a24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.109641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517c708-74ac-4ea4-9bf3-0e667a350a24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.109641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c517c708-74ac-4ea4-9bf3-0e667a350a24 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.261585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1230/2451] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:02 2021] POST /identity/v3/projects => generated 385 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:02.262897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4295-466c-4681-9d2b-92eb0cd42d33 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.280444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb4295-466c-4681-9d2b-92eb0cd42d33 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.356123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268650-117c-48f9-8c70-7cc8efb063b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.356790 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268650-117c-48f9-8c70-7cc8efb063b9 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.357070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268650-117c-48f9-8c70-7cc8efb063b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.357345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8268650-117c-48f9-8c70-7cc8efb063b9 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.358068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8268650-117c-48f9-8c70-7cc8efb063b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.360611 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8268650-117c-48f9-8c70-7cc8efb063b9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.509741 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1222/2452] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:02 2021] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:02.514467 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517c708-74ac-4ea4-9bf3-0e667a350a24 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.537707 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c517c708-74ac-4ea4-9bf3-0e667a350a24 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.544875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd4db-65e0-45e0-b438-804dac005c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.545801 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd4db-65e0-45e0-b438-804dac005c89 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.546290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd4db-65e0-45e0-b438-804dac005c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.548067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85dd4db-65e0-45e0-b438-804dac005c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.549279 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dd4db-65e0-45e0-b438-804dac005c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.551413 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85dd4db-65e0-45e0-b438-804dac005c89 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.569623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1231/2453] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:02 2021] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:02.574700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268650-117c-48f9-8c70-7cc8efb063b9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.588484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8268650-117c-48f9-8c70-7cc8efb063b9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.600973 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e810609e-ba50-4f6e-b17c-34d58e78a05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.602146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810609e-ba50-4f6e-b17c-34d58e78a05c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.602603 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810609e-ba50-4f6e-b17c-34d58e78a05c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.603049 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810609e-ba50-4f6e-b17c-34d58e78a05c admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.604955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810609e-ba50-4f6e-b17c-34d58e78a05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.606758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e810609e-ba50-4f6e-b17c-34d58e78a05c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.619273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1223/2454] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:02 2021] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:02.624253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd4db-65e0-45e0-b438-804dac005c89 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.644095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85dd4db-65e0-45e0-b438-804dac005c89 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:02.657980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a17c1f-cd96-4723-abb1-c2591f9d067a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:02.659045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a17c1f-cd96-4723-abb1-c2591f9d067a admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.659329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a17c1f-cd96-4723-abb1-c2591f9d067a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.659602 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a17c1f-cd96-4723-abb1-c2591f9d067a admin admin] PATH_INFO: `/v3/projects/c82dafc0f4204f5696cddc42ef72f322/users/102a14abd07e46cb8e526d1a4c7dd208/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.688195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a17c1f-cd96-4723-abb1-c2591f9d067a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c82dafc0f4204f5696cddc42ef72f322, user_id=102a14abd07e46cb8e526d1a4c7dd208, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:02.691277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a17c1f-cd96-4723-abb1-c2591f9d067a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:02.775373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1232/2455] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:02 2021] PUT /identity/v3/projects/c82dafc0f4204f5696cddc42ef72f322/users/102a14abd07e46cb8e526d1a4c7dd208/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:02.785681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fd23-4b7c-4d23-bc9a-dcd8b0b098b4 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:02.785962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fd23-4b7c-4d23-bc9a-dcd8b0b098b4 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:02.786473 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c0fd23-4b7c-4d23-bc9a-dcd8b0b098b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:02.824696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-96c0fd23-4b7c-4d23-bc9a-dcd8b0b098b4 None None] MFA Rules not processed for user `102a14abd07e46cb8e526d1a4c7dd208`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:02.826053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-96c0fd23-4b7c-4d23-bc9a-dcd8b0b098b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:02.941792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a17c1f-cd96-4723-abb1-c2591f9d067a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:02.943767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1224/2456] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:02 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:03.035541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a17c1f-cd96-4723-abb1-c2591f9d067a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.044631 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5455b-fa28-4087-97b1-6f250a0042f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.045434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5455b-fa28-4087-97b1-6f250a0042f8 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.048176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5455b-fa28-4087-97b1-6f250a0042f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.048176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5455b-fa28-4087-97b1-6f250a0042f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.048176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5455b-fa28-4087-97b1-6f250a0042f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.049564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5455b-fa28-4087-97b1-6f250a0042f8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.188695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1233/2457] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:02 2021] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:03.194663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0fd23-4b7c-4d23-bc9a-dcd8b0b098b4 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.214229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c0fd23-4b7c-4d23-bc9a-dcd8b0b098b4 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.292989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9608e-9e66-4322-b0a2-62797c1a7f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.293604 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9608e-9e66-4322-b0a2-62797c1a7f87 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.293864 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9608e-9e66-4322-b0a2-62797c1a7f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.294202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b9608e-9e66-4322-b0a2-62797c1a7f87 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.294975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9608e-9e66-4322-b0a2-62797c1a7f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.297273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b9608e-9e66-4322-b0a2-62797c1a7f87 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.600499 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1225/2458] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:03 2021] POST /identity/v3/users => generated 300 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:03.604914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5455b-fa28-4087-97b1-6f250a0042f8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.616634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5455b-fa28-4087-97b1-6f250a0042f8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.623075 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ef2ec-9a58-4a95-b7d9-6bac105260a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.623741 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ef2ec-9a58-4a95-b7d9-6bac105260a8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.624013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ef2ec-9a58-4a95-b7d9-6bac105260a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.624284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ef2ec-9a58-4a95-b7d9-6bac105260a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.625832 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ef2ec-9a58-4a95-b7d9-6bac105260a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.627536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ef2ec-9a58-4a95-b7d9-6bac105260a8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.646317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1234/2459] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:03 2021] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:03.651637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9608e-9e66-4322-b0a2-62797c1a7f87 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.672797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b9608e-9e66-4322-b0a2-62797c1a7f87 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.672797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8d74e-7279-4374-809f-08a0e3e5fadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.672797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8d74e-7279-4374-809f-08a0e3e5fadb admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.672797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8d74e-7279-4374-809f-08a0e3e5fadb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.673661 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8d74e-7279-4374-809f-08a0e3e5fadb admin admin] PATH_INFO: `/v3/projects/db619b304dd1472a88e432bcdee024e2/users/879e417d7d764f4290335d959e2a7149/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.714198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8d74e-7279-4374-809f-08a0e3e5fadb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db619b304dd1472a88e432bcdee024e2, user_id=879e417d7d764f4290335d959e2a7149, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.719617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8d74e-7279-4374-809f-08a0e3e5fadb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.818865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1226/2460] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:03 2021] PUT /identity/v3/projects/db619b304dd1472a88e432bcdee024e2/users/879e417d7d764f4290335d959e2a7149/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:03.822780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ef2ec-9a58-4a95-b7d9-6bac105260a8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.836761 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ef2ec-9a58-4a95-b7d9-6bac105260a8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.941132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c628984b-0d53-4a9a-8ff7-19b7719f4022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.942704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628984b-0d53-4a9a-8ff7-19b7719f4022 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.943144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628984b-0d53-4a9a-8ff7-19b7719f4022 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.943693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c628984b-0d53-4a9a-8ff7-19b7719f4022 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.945153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628984b-0d53-4a9a-8ff7-19b7719f4022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:03.948045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c628984b-0d53-4a9a-8ff7-19b7719f4022 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:03.966202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8d74e-7279-4374-809f-08a0e3e5fadb admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:03.976172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1235/2461] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:03 2021] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:03.980821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8d74e-7279-4374-809f-08a0e3e5fadb admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:03.987409 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881f8e8-1a53-4868-aa10-ad9fcb94ae59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:03.988672 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881f8e8-1a53-4868-aa10-ad9fcb94ae59 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:03.989138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881f8e8-1a53-4868-aa10-ad9fcb94ae59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:03.989761 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f881f8e8-1a53-4868-aa10-ad9fcb94ae59 admin admin] PATH_INFO: `/v3/projects/db619b304dd1472a88e432bcdee024e2/users/879e417d7d764f4290335d959e2a7149/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:03.996645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881f8e8-1a53-4868-aa10-ad9fcb94ae59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db619b304dd1472a88e432bcdee024e2, user_id=879e417d7d764f4290335d959e2a7149, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.000043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f881f8e8-1a53-4868-aa10-ad9fcb94ae59 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.013570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1227/2462] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:03 2021] PUT /identity/v3/projects/db619b304dd1472a88e432bcdee024e2/users/879e417d7d764f4290335d959e2a7149/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:04.031836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2731cb1-bff4-49d5-86da-76900919513a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.032623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2731cb1-bff4-49d5-86da-76900919513a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.033064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2731cb1-bff4-49d5-86da-76900919513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.063850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c2731cb1-bff4-49d5-86da-76900919513a None None] MFA Rules not processed for user `879e417d7d764f4290335d959e2a7149`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:04.065308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c2731cb1-bff4-49d5-86da-76900919513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.154650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1236/2463] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:04 2021] POST /identity/v3/auth/tokens => generated 3474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:04.165816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881f8e8-1a53-4868-aa10-ad9fcb94ae59 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.167842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f881f8e8-1a53-4868-aa10-ad9fcb94ae59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.231489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f881f8e8-1a53-4868-aa10-ad9fcb94ae59 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.235483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa1f8f6-a7ef-4b5d-afe7-32969739ba33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.236257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1f8f6-a7ef-4b5d-afe7-32969739ba33 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.236665 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1f8f6-a7ef-4b5d-afe7-32969739ba33 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.236977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa1f8f6-a7ef-4b5d-afe7-32969739ba33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.246854 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1f8f6-a7ef-4b5d-afe7-32969739ba33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.248360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa1f8f6-a7ef-4b5d-afe7-32969739ba33 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.260442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1228/2464] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:04 2021] GET /identity/v3/auth/tokens => generated 3474 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:04.326983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2731cb1-bff4-49d5-86da-76900919513a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.396997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2731cb1-bff4-49d5-86da-76900919513a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.401835 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.402907 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.403189 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.403461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] PATH_INFO: `/v3/users/102a14abd07e46cb8e526d1a4c7dd208` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.404907 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] RBAC: Authorizing `identity:delete_user(user_id=102a14abd07e46cb8e526d1a4c7dd208)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.407498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.668049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '102a14abd07e46cb8e526d1a4c7dd208'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.684848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '102a14abd07e46cb8e526d1a4c7dd208'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.688288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '102a14abd07e46cb8e526d1a4c7dd208'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.787129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '102a14abd07e46cb8e526d1a4c7dd208'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.798507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '102a14abd07e46cb8e526d1a4c7dd208'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:04.798507 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1237/2465] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:25:04 2021] DELETE /identity/v3/users/102a14abd07e46cb8e526d1a4c7dd208 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:04.799290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40323b6-f510-4cc2-bfa1-18c67552256f None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.799752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40323b6-f510-4cc2-bfa1-18c67552256f None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.800247 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40323b6-f510-4cc2-bfa1-18c67552256f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.821610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-a40323b6-f510-4cc2-bfa1-18c67552256f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:04.822897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a40323b6-f510-4cc2-bfa1-18c67552256f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.881346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1229/2466] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:04.892086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:04.893605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:04.949089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c30bfdc-c09e-4173-8f2b-a3664d8c18de admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:04.953211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9ba5c-06c8-4523-8f00-2f5bb925b947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:04.953935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ba5c-06c8-4523-8f00-2f5bb925b947 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:04.954246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ba5c-06c8-4523-8f00-2f5bb925b947 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:04.954517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ba5c-06c8-4523-8f00-2f5bb925b947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:04.963310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9ba5c-06c8-4523-8f00-2f5bb925b947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:04.964748 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9ba5c-06c8-4523-8f00-2f5bb925b947 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:04.974725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1238/2467] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:04 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:05.428918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40323b6-f510-4cc2-bfa1-18c67552256f None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.430428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a40323b6-f510-4cc2-bfa1-18c67552256f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:05.444105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40323b6-f510-4cc2-bfa1-18c67552256f None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.449569 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.450946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.451223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.451668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] PATH_INFO: `/v3/projects/c82dafc0f4204f5696cddc42ef72f322` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.453375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c82dafc0f4204f5696cddc42ef72f322)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.455333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:05.570269 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c82dafc0f4204f5696cddc42ef72f322', 'request_id': 'req-d899a35c-efe8-4007-b14f-24f59af15914'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:05.576533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c82dafc0f4204f5696cddc42ef72f322', 'request_id': 'req-d899a35c-efe8-4007-b14f-24f59af15914'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:05.582972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c82dafc0f4204f5696cddc42ef72f322', 'request_id': 'req-d899a35c-efe8-4007-b14f-24f59af15914'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:05.798617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] The token cache is being invalidate because project c82dafc0f4204f5696cddc42ef72f322 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:05.799170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:05.799830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:05.801953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1230/2468] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:25:05 2021] DELETE /identity/v3/projects/c82dafc0f4204f5696cddc42ef72f322 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:05.805715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9ba5c-06c8-4523-8f00-2f5bb925b947 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:05.816990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9ba5c-06c8-4523-8f00-2f5bb925b947 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:05.883053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:05.883927 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:05.884206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:05.884477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] PATH_INFO: `/v3/users/879e417d7d764f4290335d959e2a7149` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:05.885718 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=879e417d7d764f4290335d959e2a7149)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:05.887640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:06.098430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '879e417d7d764f4290335d959e2a7149'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.111201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '879e417d7d764f4290335d959e2a7149'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.118095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '879e417d7d764f4290335d959e2a7149'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.215609 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '879e417d7d764f4290335d959e2a7149'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.216222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1ddec1d1-1f73-40a3-a7e4-020a1d9fb843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '879e417d7d764f4290335d959e2a7149'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.223372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1239/2469] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:25:05 2021] DELETE /identity/v3/users/879e417d7d764f4290335d959e2a7149 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:06.657459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:06.658900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:06.672298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d899a35c-efe8-4007-b14f-24f59af15914 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:06.727650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:06.728961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:06.728961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:06.729150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] PATH_INFO: `/v3/projects/db619b304dd1472a88e432bcdee024e2` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:06.730219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db619b304dd1472a88e432bcdee024e2)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:06.732091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:06.862702 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db619b304dd1472a88e432bcdee024e2', 'request_id': 'req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.868907 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db619b304dd1472a88e432bcdee024e2', 'request_id': 'req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.874571 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db619b304dd1472a88e432bcdee024e2', 'request_id': 'req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.940883 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] The token cache is being invalidate because project db619b304dd1472a88e432bcdee024e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:06.941173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.941801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-97643424-a66e-4ac3-81a7-0b4ebcf1bd0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:06.943562 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1231/2470] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:25:06 2021] DELETE /identity/v3/projects/db619b304dd1472a88e432bcdee024e2 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:06.953349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148fc6b-e28c-4bad-9459-c1db7578ecad None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:06.953349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148fc6b-e28c-4bad-9459-c1db7578ecad None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:06.953349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9148fc6b-e28c-4bad-9459-c1db7578ecad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:06.971023 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9148fc6b-e28c-4bad-9459-c1db7578ecad None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:06.972221 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9148fc6b-e28c-4bad-9459-c1db7578ecad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:07.049848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1240/2471] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:06 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:07.058694 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892effb-e10a-4875-8b5e-79f1666699fa None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.058969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892effb-e10a-4875-8b5e-79f1666699fa None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.059254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892effb-e10a-4875-8b5e-79f1666699fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.079120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8892effb-e10a-4875-8b5e-79f1666699fa None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:07.080291 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8892effb-e10a-4875-8b5e-79f1666699fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:07.087894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1232/2472] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:07.091957 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148fc6b-e28c-4bad-9459-c1db7578ecad None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.102089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9148fc6b-e28c-4bad-9459-c1db7578ecad None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.106615 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745f2ae-2c34-4a6b-b3ec-a5fa551a60b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.107254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745f2ae-2c34-4a6b-b3ec-a5fa551a60b0 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.107526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745f2ae-2c34-4a6b-b3ec-a5fa551a60b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.107796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c745f2ae-2c34-4a6b-b3ec-a5fa551a60b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.108516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745f2ae-2c34-4a6b-b3ec-a5fa551a60b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:07.109587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745f2ae-2c34-4a6b-b3ec-a5fa551a60b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.111310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c745f2ae-2c34-4a6b-b3ec-a5fa551a60b0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.130481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1241/2473] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:25:07 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:07.133084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892effb-e10a-4875-8b5e-79f1666699fa None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.143763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892effb-e10a-4875-8b5e-79f1666699fa None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.149529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323a326-47e6-4187-87ac-b52cb46cd603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.150521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323a326-47e6-4187-87ac-b52cb46cd603 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.150910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323a326-47e6-4187-87ac-b52cb46cd603 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.151296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323a326-47e6-4187-87ac-b52cb46cd603 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.152366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323a326-47e6-4187-87ac-b52cb46cd603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.155343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323a326-47e6-4187-87ac-b52cb46cd603 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.252191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1233/2474] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:07 2021] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:07.256365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745f2ae-2c34-4a6b-b3ec-a5fa551a60b0 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.266308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c745f2ae-2c34-4a6b-b3ec-a5fa551a60b0 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.320029 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbae20-8789-4489-afd7-56ebd4e4481a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.320687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbae20-8789-4489-afd7-56ebd4e4481a admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.320966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbae20-8789-4489-afd7-56ebd4e4481a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.321235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbae20-8789-4489-afd7-56ebd4e4481a admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.321929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbae20-8789-4489-afd7-56ebd4e4481a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.323889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbae20-8789-4489-afd7-56ebd4e4481a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.438648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1242/2475] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:07 2021] POST /identity/v3/users => generated 284 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:07.442509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323a326-47e6-4187-87ac-b52cb46cd603 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.452833 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323a326-47e6-4187-87ac-b52cb46cd603 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.457414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d41d-c153-4306-a0be-fc155a150aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.458096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d41d-c153-4306-a0be-fc155a150aff admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.458376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d41d-c153-4306-a0be-fc155a150aff admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.458645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304d41d-c153-4306-a0be-fc155a150aff admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.459400 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304d41d-c153-4306-a0be-fc155a150aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.460960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304d41d-c153-4306-a0be-fc155a150aff admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.471720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1234/2476] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:07.475675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbae20-8789-4489-afd7-56ebd4e4481a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.486533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbae20-8789-4489-afd7-56ebd4e4481a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.491389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288037d-dc3a-45d5-8561-0a8eea065242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.492036 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288037d-dc3a-45d5-8561-0a8eea065242 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.492318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288037d-dc3a-45d5-8561-0a8eea065242 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.492592 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288037d-dc3a-45d5-8561-0a8eea065242 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.493321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288037d-dc3a-45d5-8561-0a8eea065242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.494967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288037d-dc3a-45d5-8561-0a8eea065242 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.504767 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1243/2477] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:07 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:07.508674 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d41d-c153-4306-a0be-fc155a150aff admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.518659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304d41d-c153-4306-a0be-fc155a150aff admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.523147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecd69f-63cb-42dc-b403-8a708becf4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.524040 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecd69f-63cb-42dc-b403-8a708becf4da admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.524312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecd69f-63cb-42dc-b403-8a708becf4da admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.524580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ecd69f-63cb-42dc-b403-8a708becf4da admin admin] PATH_INFO: `/v3/projects/e2e7dc1a7e8d4189be67e3a7f684705a/users/7444203f87e24c57820e95723238db10/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.538947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecd69f-63cb-42dc-b403-8a708becf4da admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2e7dc1a7e8d4189be67e3a7f684705a, user_id=7444203f87e24c57820e95723238db10, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.541505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ecd69f-63cb-42dc-b403-8a708becf4da admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.609239 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1235/2478] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:07 2021] PUT /identity/v3/projects/e2e7dc1a7e8d4189be67e3a7f684705a/users/7444203f87e24c57820e95723238db10/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:07.619685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dcdc1-082d-44e9-8a66-b79bea1d7ef0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.622899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dcdc1-082d-44e9-8a66-b79bea1d7ef0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.622899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13dcdc1-082d-44e9-8a66-b79bea1d7ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.646452 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-c13dcdc1-082d-44e9-8a66-b79bea1d7ef0 None None] MFA Rules not processed for user `7444203f87e24c57820e95723238db10`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:07.647628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-c13dcdc1-082d-44e9-8a66-b79bea1d7ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:07.708564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1244/2479] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:07 2021] POST /identity/v3/auth/tokens => generated 3387 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:07.712977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecd69f-63cb-42dc-b403-8a708becf4da admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.772510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ecd69f-63cb-42dc-b403-8a708becf4da admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.777136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d6ed9-1a25-4ccd-add1-b088984e9434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.777782 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d6ed9-1a25-4ccd-add1-b088984e9434 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.778092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d6ed9-1a25-4ccd-add1-b088984e9434 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.778368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d6ed9-1a25-4ccd-add1-b088984e9434 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.779071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d6ed9-1a25-4ccd-add1-b088984e9434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.781742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4d6ed9-1a25-4ccd-add1-b088984e9434 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:07.862651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1236/2480] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:07 2021] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:07.866682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dcdc1-082d-44e9-8a66-b79bea1d7ef0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:07.877333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13dcdc1-082d-44e9-8a66-b79bea1d7ef0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:07.934205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9f123-c3d9-44d5-9bc7-cf87c0cd4255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:07.934997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9f123-c3d9-44d5-9bc7-cf87c0cd4255 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:07.935374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9f123-c3d9-44d5-9bc7-cf87c0cd4255 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:07.935730 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a9f123-c3d9-44d5-9bc7-cf87c0cd4255 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:07.936509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9f123-c3d9-44d5-9bc7-cf87c0cd4255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:07.938867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a9f123-c3d9-44d5-9bc7-cf87c0cd4255 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.038401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1245/2481] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:07 2021] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:08.042418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d6ed9-1a25-4ccd-add1-b088984e9434 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.059094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d6ed9-1a25-4ccd-add1-b088984e9434 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.068656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c94d-8e63-4d29-823a-d6562d7f6b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.068656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c94d-8e63-4d29-823a-d6562d7f6b6f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.068656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c94d-8e63-4d29-823a-d6562d7f6b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.068656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4c94d-8e63-4d29-823a-d6562d7f6b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.069301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4c94d-8e63-4d29-823a-d6562d7f6b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.069301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e4c94d-8e63-4d29-823a-d6562d7f6b6f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.080240 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1237/2482] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:08 2021] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:25:08.084450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9f123-c3d9-44d5-9bc7-cf87c0cd4255 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.096195 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a9f123-c3d9-44d5-9bc7-cf87c0cd4255 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.101464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f729cc-da5f-442e-a1c4-d1e0c79b4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.103644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f729cc-da5f-442e-a1c4-d1e0c79b4d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.104549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f729cc-da5f-442e-a1c4-d1e0c79b4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.104985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f729cc-da5f-442e-a1c4-d1e0c79b4d47 admin admin] PATH_INFO: `/v3/projects/1a72fccf883e4f0087b0b5410e70a868/users/1fc7665a70204adf91ee6b11ff4af7ba/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.129491 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f729cc-da5f-442e-a1c4-d1e0c79b4d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a72fccf883e4f0087b0b5410e70a868, user_id=1fc7665a70204adf91ee6b11ff4af7ba, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.132745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f729cc-da5f-442e-a1c4-d1e0c79b4d47 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.195573 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1246/2483] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:08 2021] PUT /identity/v3/projects/1a72fccf883e4f0087b0b5410e70a868/users/1fc7665a70204adf91ee6b11ff4af7ba/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:08.199869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c94d-8e63-4d29-823a-d6562d7f6b6f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.210340 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4c94d-8e63-4d29-823a-d6562d7f6b6f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.268942 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36350d1f-c957-482b-92fe-66c14ad9a754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.269606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350d1f-c957-482b-92fe-66c14ad9a754 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.269884 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350d1f-c957-482b-92fe-66c14ad9a754 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.270214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36350d1f-c957-482b-92fe-66c14ad9a754 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.270955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36350d1f-c957-482b-92fe-66c14ad9a754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.272521 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36350d1f-c957-482b-92fe-66c14ad9a754 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.283069 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1238/2484] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:08 2021] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:08.287295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f729cc-da5f-442e-a1c4-d1e0c79b4d47 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.298336 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f729cc-da5f-442e-a1c4-d1e0c79b4d47 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.302878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b40e1-4895-4a7e-81ca-ff1f620de751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.303746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b40e1-4895-4a7e-81ca-ff1f620de751 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.304020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b40e1-4895-4a7e-81ca-ff1f620de751 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.304287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b40e1-4895-4a7e-81ca-ff1f620de751 admin admin] PATH_INFO: `/v3/projects/1a72fccf883e4f0087b0b5410e70a868/users/1fc7665a70204adf91ee6b11ff4af7ba/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.306259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b40e1-4895-4a7e-81ca-ff1f620de751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a72fccf883e4f0087b0b5410e70a868, user_id=1fc7665a70204adf91ee6b11ff4af7ba, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.308864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b40e1-4895-4a7e-81ca-ff1f620de751 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.319487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1247/2485] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:08 2021] PUT /identity/v3/projects/1a72fccf883e4f0087b0b5410e70a868/users/1fc7665a70204adf91ee6b11ff4af7ba/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:08.329632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ea50-052f-4260-ab82-e2efeaf96fb7 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.329914 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ea50-052f-4260-ab82-e2efeaf96fb7 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.330217 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3ea50-052f-4260-ab82-e2efeaf96fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.356321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-17e3ea50-052f-4260-ab82-e2efeaf96fb7 None None] MFA Rules not processed for user `1fc7665a70204adf91ee6b11ff4af7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:08.357516 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-17e3ea50-052f-4260-ab82-e2efeaf96fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:08.422352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1239/2486] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:08 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:08.432797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b40e1-4895-4a7e-81ca-ff1f620de751 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.434495 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-849b40e1-4895-4a7e-81ca-ff1f620de751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:08.491561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b40e1-4895-4a7e-81ca-ff1f620de751 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.495135 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bedfdb-a089-4581-b0d0-1a808875f8a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.495776 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bedfdb-a089-4581-b0d0-1a808875f8a5 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.496058 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bedfdb-a089-4581-b0d0-1a808875f8a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.496334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bedfdb-a089-4581-b0d0-1a808875f8a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.505575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bedfdb-a089-4581-b0d0-1a808875f8a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.507031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bedfdb-a089-4581-b0d0-1a808875f8a5 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.517282 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1248/2487] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:08 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:08.744907 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3ea50-052f-4260-ab82-e2efeaf96fb7 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:08.754826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3ea50-052f-4260-ab82-e2efeaf96fb7 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:08.758600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67b1e33-c0d1-419e-bf60-ba38b27fa80e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:08.759231 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b1e33-c0d1-419e-bf60-ba38b27fa80e service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:08.759511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b1e33-c0d1-419e-bf60-ba38b27fa80e service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:08.759785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67b1e33-c0d1-419e-bf60-ba38b27fa80e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:08.815522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b1e33-c0d1-419e-bf60-ba38b27fa80e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:08.816946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67b1e33-c0d1-419e-bf60-ba38b27fa80e service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:08.826427 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1240/2488] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:08 2021] GET /identity/v3/auth/tokens => generated 3387 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:11.596859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c710b7-af18-4903-beea-c1b236a645e5 None None] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.597470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c710b7-af18-4903-beea-c1b236a645e5 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.597470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c710b7-af18-4903-beea-c1b236a645e5 None None] PATH_INFO: `/` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.599394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1249/2489] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:25:11 2021] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:11.605673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede4052-2012-4529-bbc1-e7eefb348a8b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.606220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede4052-2012-4529-bbc1-e7eefb348a8b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.606332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eede4052-2012-4529-bbc1-e7eefb348a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.625119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-eede4052-2012-4529-bbc1-e7eefb348a8b None None] MFA Rules not processed for user `d1596a916d784f6bb6e3b876f4820903`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:11.626449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-eede4052-2012-4529-bbc1-e7eefb348a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:11.705690 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1241/2490] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:25:11 2021] POST /identity/v3/auth/tokens => generated 3515 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:11.718840 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c710b7-af18-4903-beea-c1b236a645e5 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:11.720509 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-81c710b7-af18-4903-beea-c1b236a645e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:11.799513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c710b7-af18-4903-beea-c1b236a645e5 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:11.803026 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e5658-550e-4d44-999a-3e8a62dc785e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f402e17093e4e99afda5ea019f335eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:11.803659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5658-550e-4d44-999a-3e8a62dc785e service glance] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:11.803934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5658-550e-4d44-999a-3e8a62dc785e service glance] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:11.804205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e5658-550e-4d44-999a-3e8a62dc785e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:11.814123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e5658-550e-4d44-999a-3e8a62dc785e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:11.815567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e5658-550e-4d44-999a-3e8a62dc785e service glance] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:11.825809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1250/2491] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:11 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:12.098207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691258-9fea-4cb4-a2b5-8d49538f3882 None None] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:12.098591 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691258-9fea-4cb4-a2b5-8d49538f3882 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:12.099048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df691258-9fea-4cb4-a2b5-8d49538f3882 None None] PATH_INFO: `/` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:12.100933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1242/2492] 10.222.0.32 () {54 vars in 921 bytes} [Wed Oct 27 01:25:12 2021] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 27 01:25:12.106605 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4d28-a0b2-494d-940c-10853015d225 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:12.106977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4d28-a0b2-494d-940c-10853015d225 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:12.107314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f4d28-a0b2-494d-940c-10853015d225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:12.125917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-337f4d28-a0b2-494d-940c-10853015d225 None None] MFA Rules not processed for user `66c74b04afed4aabbdbee054438a4933`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:12.127150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-337f4d28-a0b2-494d-940c-10853015d225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:12.204640 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1251/2493] 10.222.0.32 () {58 vars in 1018 bytes} [Wed Oct 27 01:25:12 2021] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:12.220802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df691258-9fea-4cb4-a2b5-8d49538f3882 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:12.222792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-df691258-9fea-4cb4-a2b5-8d49538f3882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:12.241588 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df691258-9fea-4cb4-a2b5-8d49538f3882 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:12.245511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb3e47-0950-40e4-b1b7-6ae3ac112b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:12.246266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb3e47-0950-40e4-b1b7-6ae3ac112b88 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:12.246466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb3e47-0950-40e4-b1b7-6ae3ac112b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:12.246734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb3e47-0950-40e4-b1b7-6ae3ac112b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:12.255128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb3e47-0950-40e4-b1b7-6ae3ac112b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:12.256634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb3e47-0950-40e4-b1b7-6ae3ac112b88 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:12.265428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1243/2494] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:12 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:15.279909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e5609-7a1c-4092-ba4b-bd4585abcff0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:15.281056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e5609-7a1c-4092-ba4b-bd4585abcff0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:15.281203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2e5609-7a1c-4092-ba4b-bd4585abcff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:15.301435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-2a2e5609-7a1c-4092-ba4b-bd4585abcff0 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:15.302896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2a2e5609-7a1c-4092-ba4b-bd4585abcff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:15.360201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1252/2495] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:25:15 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:15.378175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb3e47-0950-40e4-b1b7-6ae3ac112b88 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:15.379071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a7bb3e47-0950-40e4-b1b7-6ae3ac112b88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:15.384392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e5609-7a1c-4092-ba4b-bd4585abcff0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:15.453024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb3e47-0950-40e4-b1b7-6ae3ac112b88 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:15.458331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980af47-4ae8-450c-85b2-cb96aa2ad5f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:15.461250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980af47-4ae8-450c-85b2-cb96aa2ad5f5 service swift] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:15.461360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2e5609-7a1c-4092-ba4b-bd4585abcff0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:15.461447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980af47-4ae8-450c-85b2-cb96aa2ad5f5 service swift] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:15.461447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980af47-4ae8-450c-85b2-cb96aa2ad5f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:15.463627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:15.464628 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:15.464961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:15.465318 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] PATH_INFO: `/v3/users/7444203f87e24c57820e95723238db10` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:15.466594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7444203f87e24c57820e95723238db10)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:15.468807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980af47-4ae8-450c-85b2-cb96aa2ad5f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:15.468992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:15.470414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980af47-4ae8-450c-85b2-cb96aa2ad5f5 service swift] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:15.478958 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1244/2496] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:25:15 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:25:15.705575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7444203f87e24c57820e95723238db10'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:15.720439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7444203f87e24c57820e95723238db10'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:15.732018 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7444203f87e24c57820e95723238db10'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:15.815539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7444203f87e24c57820e95723238db10'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:15.816251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7444203f87e24c57820e95723238db10'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:15.827060 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1253/2497] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:25:15 2021] DELETE /identity/v3/users/7444203f87e24c57820e95723238db10 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:15.828374 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fedb6-6047-4cc0-85ee-efdb72b5d870 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:15.828967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fedb6-6047-4cc0-85ee-efdb72b5d870 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:15.829362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5fedb6-6047-4cc0-85ee-efdb72b5d870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:15.856250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-ca5fedb6-6047-4cc0-85ee-efdb72b5d870 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:15.858145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ca5fedb6-6047-4cc0-85ee-efdb72b5d870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:15.926910 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1245/2498] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:15 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:15.937625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:15.939338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:16.008676 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c2103-fa50-44c1-86b9-f6bc23e65ea8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:16.012685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d51a66-0ac7-40e0-bb66-29ff58385a40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:16.013435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d51a66-0ac7-40e0-bb66-29ff58385a40 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:16.013770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d51a66-0ac7-40e0-bb66-29ff58385a40 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:16.014187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d51a66-0ac7-40e0-bb66-29ff58385a40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:16.024977 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d51a66-0ac7-40e0-bb66-29ff58385a40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:16.026498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d51a66-0ac7-40e0-bb66-29ff58385a40 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:16.039399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1254/2499] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:15 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:16.562903 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fedb6-6047-4cc0-85ee-efdb72b5d870 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:16.564650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-ca5fedb6-6047-4cc0-85ee-efdb72b5d870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:16.596533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5fedb6-6047-4cc0-85ee-efdb72b5d870 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:16.616948 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:16.617824 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:16.618137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:16.618413 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] PATH_INFO: `/v3/projects/e2e7dc1a7e8d4189be67e3a7f684705a` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:16.619833 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2e7dc1a7e8d4189be67e3a7f684705a)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:16.621801 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:16.792241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2e7dc1a7e8d4189be67e3a7f684705a', 'request_id': 'req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:16.798236 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2e7dc1a7e8d4189be67e3a7f684705a', 'request_id': 'req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:16.803432 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2e7dc1a7e8d4189be67e3a7f684705a', 'request_id': 'req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:16.901576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] The token cache is being invalidate because project e2e7dc1a7e8d4189be67e3a7f684705a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:16.901961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:16.902756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:16.908006 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1246/2500] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:25:16 2021] DELETE /identity/v3/projects/e2e7dc1a7e8d4189be67e3a7f684705a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:16.909174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d51a66-0ac7-40e0-bb66-29ff58385a40 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:16.919238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d51a66-0ac7-40e0-bb66-29ff58385a40 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:16.977265 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:16.978164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:16.978520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:16.978799 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] PATH_INFO: `/v3/users/1fc7665a70204adf91ee6b11ff4af7ba` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:16.980043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fc7665a70204adf91ee6b11ff4af7ba)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:16.981978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:17.155210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fc7665a70204adf91ee6b11ff4af7ba'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:17.169149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fc7665a70204adf91ee6b11ff4af7ba'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:17.178056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fc7665a70204adf91ee6b11ff4af7ba'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:17.255929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fc7665a70204adf91ee6b11ff4af7ba'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:17.256360 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-bce6e915-6eb9-4cfc-a810-8774f4d0c391 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fc7665a70204adf91ee6b11ff4af7ba'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:17.263653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1255/2501] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:25:16 2021] DELETE /identity/v3/users/1fc7665a70204adf91ee6b11ff4af7ba => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:17.734667 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:17.735134 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:17.752264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7521de-0716-4da4-b40e-ca8bb4f9b15f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:17.839103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:17.840280 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:17.840794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:17.841261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] PATH_INFO: `/v3/projects/1a72fccf883e4f0087b0b5410e70a868` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:17.843066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a72fccf883e4f0087b0b5410e70a868)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:17.845700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:17.959245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a72fccf883e4f0087b0b5410e70a868', 'request_id': 'req-05059e74-f8d4-4f13-b180-157db814dbea'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:17.966960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a72fccf883e4f0087b0b5410e70a868', 'request_id': 'req-05059e74-f8d4-4f13-b180-157db814dbea'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:17.975043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a72fccf883e4f0087b0b5410e70a868', 'request_id': 'req-05059e74-f8d4-4f13-b180-157db814dbea'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:18.078859 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] The token cache is being invalidate because project 1a72fccf883e4f0087b0b5410e70a868 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:18.079092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:18.079720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-05059e74-f8d4-4f13-b180-157db814dbea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:18.081251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1247/2502] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:25:17 2021] DELETE /identity/v3/projects/1a72fccf883e4f0087b0b5410e70a868 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:18.086905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f558c-aa3a-46ad-b4fc-cd1fcc1c56db None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.087422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f558c-aa3a-46ad-b4fc-cd1fcc1c56db None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.087521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674f558c-aa3a-46ad-b4fc-cd1fcc1c56db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.106443 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-674f558c-aa3a-46ad-b4fc-cd1fcc1c56db None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:18.107646 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-674f558c-aa3a-46ad-b4fc-cd1fcc1c56db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:18.167433 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1256/2503] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:18.175585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ecbf1-b8de-4928-849a-2dda57e3cb59 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.175869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ecbf1-b8de-4928-849a-2dda57e3cb59 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.176193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ecbf1-b8de-4928-849a-2dda57e3cb59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.196918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e38ecbf1-b8de-4928-849a-2dda57e3cb59 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:18.198234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e38ecbf1-b8de-4928-849a-2dda57e3cb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:18.213086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1248/2504] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:18 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:18.213978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f558c-aa3a-46ad-b4fc-cd1fcc1c56db None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:18.223971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674f558c-aa3a-46ad-b4fc-cd1fcc1c56db None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:18.229263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425c3f-d64e-4aff-a868-7b06622e1a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:18.230183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425c3f-d64e-4aff-a868-7b06622e1a7d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.230655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425c3f-d64e-4aff-a868-7b06622e1a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.231143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c425c3f-d64e-4aff-a868-7b06622e1a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.232067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c425c3f-d64e-4aff-a868-7b06622e1a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:18.232549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c425c3f-d64e-4aff-a868-7b06622e1a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:18.234410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c425c3f-d64e-4aff-a868-7b06622e1a7d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:18.246611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1257/2505] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:25:18 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:25:18.251781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ecbf1-b8de-4928-849a-2dda57e3cb59 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:18.261282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ecbf1-b8de-4928-849a-2dda57e3cb59 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:18.267235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eea511-c24d-4e5c-8ce4-91c5593bd4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:18.267893 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea511-c24d-4e5c-8ce4-91c5593bd4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.268170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea511-c24d-4e5c-8ce4-91c5593bd4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.268435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eea511-c24d-4e5c-8ce4-91c5593bd4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.269142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eea511-c24d-4e5c-8ce4-91c5593bd4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:18.271063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eea511-c24d-4e5c-8ce4-91c5593bd4e1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:18.370612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1249/2506] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:18 2021] POST /identity/v3/projects => generated 381 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:18.371766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425c3f-d64e-4aff-a868-7b06622e1a7d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:18.382988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c425c3f-d64e-4aff-a868-7b06622e1a7d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:18.441619 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d957e-8d5f-4b97-ba30-6c1837eb4702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:18.442339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d957e-8d5f-4b97-ba30-6c1837eb4702 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.442616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d957e-8d5f-4b97-ba30-6c1837eb4702 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.442884 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3d957e-8d5f-4b97-ba30-6c1837eb4702 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.443581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d957e-8d5f-4b97-ba30-6c1837eb4702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:18.445459 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3d957e-8d5f-4b97-ba30-6c1837eb4702 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:18.541980 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1258/2507] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:18 2021] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:18.546680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eea511-c24d-4e5c-8ce4-91c5593bd4e1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:18.557234 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eea511-c24d-4e5c-8ce4-91c5593bd4e1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:18.562638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91cf6a-ce1b-47bf-8e46-6563dc5dcebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:18.563301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91cf6a-ce1b-47bf-8e46-6563dc5dcebc admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.563577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91cf6a-ce1b-47bf-8e46-6563dc5dcebc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.563847 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e91cf6a-ce1b-47bf-8e46-6563dc5dcebc admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.564636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91cf6a-ce1b-47bf-8e46-6563dc5dcebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:18.566233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e91cf6a-ce1b-47bf-8e46-6563dc5dcebc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:18.578314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1250/2508] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:18.582262 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d957e-8d5f-4b97-ba30-6c1837eb4702 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:18.593118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3d957e-8d5f-4b97-ba30-6c1837eb4702 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:18.598068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1523ab-de2d-4845-a5ce-f053faf3a572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:18.598862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1523ab-de2d-4845-a5ce-f053faf3a572 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.599246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1523ab-de2d-4845-a5ce-f053faf3a572 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.599606 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1523ab-de2d-4845-a5ce-f053faf3a572 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.600463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1523ab-de2d-4845-a5ce-f053faf3a572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:18.602424 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1523ab-de2d-4845-a5ce-f053faf3a572 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:18.613796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1259/2509] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:18 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:18.618176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91cf6a-ce1b-47bf-8e46-6563dc5dcebc admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:18.628607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e91cf6a-ce1b-47bf-8e46-6563dc5dcebc admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:18.633251 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455ec24-e5d2-4535-8616-518d990470c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:18.634441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ec24-e5d2-4535-8616-518d990470c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.634917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ec24-e5d2-4535-8616-518d990470c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.635241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455ec24-e5d2-4535-8616-518d990470c7 admin admin] PATH_INFO: `/v3/projects/5f8b086045544615aeb285c7e0c136a5/users/6acc26485c544e4aa77d11d67e16a0ed/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.650147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455ec24-e5d2-4535-8616-518d990470c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8b086045544615aeb285c7e0c136a5, user_id=6acc26485c544e4aa77d11d67e16a0ed, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:18.652856 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455ec24-e5d2-4535-8616-518d990470c7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:18.730444 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1251/2510] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:18 2021] PUT /identity/v3/projects/5f8b086045544615aeb285c7e0c136a5/users/6acc26485c544e4aa77d11d67e16a0ed/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:18.731824 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8e7c-7150-42fe-9791-0a6c31b76339 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.732193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8e7c-7150-42fe-9791-0a6c31b76339 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.732547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed8e7c-7150-42fe-9791-0a6c31b76339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.762317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-fbed8e7c-7150-42fe-9791-0a6c31b76339 None None] MFA Rules not processed for user `6acc26485c544e4aa77d11d67e16a0ed`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:18.763723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fbed8e7c-7150-42fe-9791-0a6c31b76339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:18.852233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1260/2511] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:18 2021] POST /identity/v3/auth/tokens => generated 3401 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:18.862395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455ec24-e5d2-4535-8616-518d990470c7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:18.865297 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a455ec24-e5d2-4535-8616-518d990470c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:18.927053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455ec24-e5d2-4535-8616-518d990470c7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:18.931793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0910a2-2192-4410-81db-53d24524732e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:18.931793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0910a2-2192-4410-81db-53d24524732e service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:18.931793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0910a2-2192-4410-81db-53d24524732e service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:18.931793 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0910a2-2192-4410-81db-53d24524732e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:18.942416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0910a2-2192-4410-81db-53d24524732e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:18.943898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0910a2-2192-4410-81db-53d24524732e service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:18.955656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1252/2512] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:18 2021] GET /identity/v3/auth/tokens => generated 3401 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:18.978356 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed8e7c-7150-42fe-9791-0a6c31b76339 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:19.073153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed8e7c-7150-42fe-9791-0a6c31b76339 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:19.078797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:19.079754 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:19.079990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:19.081112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] PATH_INFO: `/v3/users/6acc26485c544e4aa77d11d67e16a0ed` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:19.082517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6acc26485c544e4aa77d11d67e16a0ed)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:19.084395 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:19.254064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6acc26485c544e4aa77d11d67e16a0ed'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:19.264406 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6acc26485c544e4aa77d11d67e16a0ed'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:19.272310 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6acc26485c544e4aa77d11d67e16a0ed'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:19.369654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6acc26485c544e4aa77d11d67e16a0ed'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:19.370311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6acc26485c544e4aa77d11d67e16a0ed'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:19.377329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1261/2513] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:25:18 2021] DELETE /identity/v3/users/6acc26485c544e4aa77d11d67e16a0ed => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:19.381906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f829f-9bf7-4fef-89b9-23483d2370d9 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:19.385246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f829f-9bf7-4fef-89b9-23483d2370d9 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:19.385246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417f829f-9bf7-4fef-89b9-23483d2370d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:19.414853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-417f829f-9bf7-4fef-89b9-23483d2370d9 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:19.416227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-417f829f-9bf7-4fef-89b9-23483d2370d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:19.479201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1253/2514] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:19 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:19.489648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:19.491056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:19.552330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f196aca-fd8d-4779-ad9b-eec825d9810e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:19.555890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc851a6b-7949-4ed1-9be8-9374957fc8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:19.556539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc851a6b-7949-4ed1-9be8-9374957fc8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:19.556805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc851a6b-7949-4ed1-9be8-9374957fc8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:19.557074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc851a6b-7949-4ed1-9be8-9374957fc8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:19.566833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc851a6b-7949-4ed1-9be8-9374957fc8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:19.568263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc851a6b-7949-4ed1-9be8-9374957fc8f1 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:19.578174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1262/2515] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:19 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:20.022750 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f829f-9bf7-4fef-89b9-23483d2370d9 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:20.024250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-417f829f-9bf7-4fef-89b9-23483d2370d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:20.037970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417f829f-9bf7-4fef-89b9-23483d2370d9 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:20.044206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:20.046124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.046574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.047198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] PATH_INFO: `/v3/projects/5f8b086045544615aeb285c7e0c136a5` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:20.077461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8b086045544615aeb285c7e0c136a5)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:20.079507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:20.197022 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8b086045544615aeb285c7e0c136a5', 'request_id': 'req-7bbc1558-3b05-4c97-a010-44399dd6cad6'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:20.204720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8b086045544615aeb285c7e0c136a5', 'request_id': 'req-7bbc1558-3b05-4c97-a010-44399dd6cad6'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:20.210510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8b086045544615aeb285c7e0c136a5', 'request_id': 'req-7bbc1558-3b05-4c97-a010-44399dd6cad6'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:20.277420 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] The token cache is being invalidate because project 5f8b086045544615aeb285c7e0c136a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:20.277709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:20.278381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7bbc1558-3b05-4c97-a010-44399dd6cad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:20.283815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1254/2516] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:25:20 2021] DELETE /identity/v3/projects/5f8b086045544615aeb285c7e0c136a5 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:20.288389 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4637e-debf-40a3-bf4a-efbdc01ca6b4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.288892 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4637e-debf-40a3-bf4a-efbdc01ca6b4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.288981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb4637e-debf-40a3-bf4a-efbdc01ca6b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:20.309204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-bbb4637e-debf-40a3-bf4a-efbdc01ca6b4 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:20.310687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bbb4637e-debf-40a3-bf4a-efbdc01ca6b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:20.375098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1263/2517] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:20.382951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373e4b0-e434-460a-82b1-35dfa18370ca None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.383237 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373e4b0-e434-460a-82b1-35dfa18370ca None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.383515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373e4b0-e434-460a-82b1-35dfa18370ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:20.402018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2373e4b0-e434-460a-82b1-35dfa18370ca None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:20.403417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2373e4b0-e434-460a-82b1-35dfa18370ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:20.413158 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1255/2518] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:20.417546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4637e-debf-40a3-bf4a-efbdc01ca6b4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:20.427766 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb4637e-debf-40a3-bf4a-efbdc01ca6b4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:20.432439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74360f-5a49-4611-9e47-25399f9adc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:20.433247 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74360f-5a49-4611-9e47-25399f9adc35 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.433527 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74360f-5a49-4611-9e47-25399f9adc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.433797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74360f-5a49-4611-9e47-25399f9adc35 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:20.434555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74360f-5a49-4611-9e47-25399f9adc35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:20.434855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74360f-5a49-4611-9e47-25399f9adc35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:20.436486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74360f-5a49-4611-9e47-25399f9adc35 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:20.448529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1264/2519] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:25:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:20.454359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373e4b0-e434-460a-82b1-35dfa18370ca None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:20.463822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373e4b0-e434-460a-82b1-35dfa18370ca None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:20.469207 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c4e88-aec9-4c2b-83cc-a4d8929a754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:20.469921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c4e88-aec9-4c2b-83cc-a4d8929a754d admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.470224 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c4e88-aec9-4c2b-83cc-a4d8929a754d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.470496 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c4e88-aec9-4c2b-83cc-a4d8929a754d admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:20.471196 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c4e88-aec9-4c2b-83cc-a4d8929a754d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:20.473068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c4e88-aec9-4c2b-83cc-a4d8929a754d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:20.602869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1256/2520] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:20 2021] POST /identity/v3/projects => generated 391 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:20.607063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74360f-5a49-4611-9e47-25399f9adc35 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:20.617901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74360f-5a49-4611-9e47-25399f9adc35 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:20.675641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca4a2-8a46-4e23-b3e0-3a338b4c2b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:20.676306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca4a2-8a46-4e23-b3e0-3a338b4c2b5e admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.676576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca4a2-8a46-4e23-b3e0-3a338b4c2b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.676845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824ca4a2-8a46-4e23-b3e0-3a338b4c2b5e admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:20.677540 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca4a2-8a46-4e23-b3e0-3a338b4c2b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:20.679464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824ca4a2-8a46-4e23-b3e0-3a338b4c2b5e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:20.765814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1265/2521] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:20 2021] POST /identity/v3/users => generated 296 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:20.769620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c4e88-aec9-4c2b-83cc-a4d8929a754d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:20.780759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c4e88-aec9-4c2b-83cc-a4d8929a754d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:20.785946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8d03b-88a7-4f62-9202-a973d9a4f416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:20.786678 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8d03b-88a7-4f62-9202-a973d9a4f416 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.787002 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8d03b-88a7-4f62-9202-a973d9a4f416 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.787359 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8d03b-88a7-4f62-9202-a973d9a4f416 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:20.788172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8d03b-88a7-4f62-9202-a973d9a4f416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:20.789767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8d03b-88a7-4f62-9202-a973d9a4f416 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:20.800911 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1257/2522] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:25:20.805009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca4a2-8a46-4e23-b3e0-3a338b4c2b5e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:20.815528 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824ca4a2-8a46-4e23-b3e0-3a338b4c2b5e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:20.820311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7db9400-1957-4f3e-a457-62200c8d920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:20.821016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9400-1957-4f3e-a457-62200c8d920e admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.824975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9400-1957-4f3e-a457-62200c8d920e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.824975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7db9400-1957-4f3e-a457-62200c8d920e admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:20.824975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9400-1957-4f3e-a457-62200c8d920e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:20.824975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7db9400-1957-4f3e-a457-62200c8d920e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:20.835365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1266/2523] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:20 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:20.839625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8d03b-88a7-4f62-9202-a973d9a4f416 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:20.850747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8d03b-88a7-4f62-9202-a973d9a4f416 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:20.855883 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99ca6b-6d50-4085-9f06-1e869b9d5a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:20.856818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99ca6b-6d50-4085-9f06-1e869b9d5a2d admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.857155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99ca6b-6d50-4085-9f06-1e869b9d5a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.857459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a99ca6b-6d50-4085-9f06-1e869b9d5a2d admin admin] PATH_INFO: `/v3/projects/88b3d604c12c4ce0969ee220c7e93df1/users/8568823cd18147a2833b3778454b601d/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:20.873318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99ca6b-6d50-4085-9f06-1e869b9d5a2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b3d604c12c4ce0969ee220c7e93df1, user_id=8568823cd18147a2833b3778454b601d, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:20.876246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a99ca6b-6d50-4085-9f06-1e869b9d5a2d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:20.979076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1258/2524] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:20 2021] PUT /identity/v3/projects/88b3d604c12c4ce0969ee220c7e93df1/users/8568823cd18147a2833b3778454b601d/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:20.989992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072b1af-fdde-4688-b902-ad703cb9daec None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:20.990307 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072b1af-fdde-4688-b902-ad703cb9daec None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:20.990587 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f072b1af-fdde-4688-b902-ad703cb9daec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:21.018960 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f072b1af-fdde-4688-b902-ad703cb9daec None None] MFA Rules not processed for user `8568823cd18147a2833b3778454b601d`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:21.020238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f072b1af-fdde-4688-b902-ad703cb9daec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:21.087280 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1267/2525] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:20 2021] POST /identity/v3/auth/tokens => generated 3411 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:21.097308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99ca6b-6d50-4085-9f06-1e869b9d5a2d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:21.099710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-7a99ca6b-6d50-4085-9f06-1e869b9d5a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:21.163877 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a99ca6b-6d50-4085-9f06-1e869b9d5a2d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:21.168136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87437e-7211-4e82-a013-fb2d0a199819 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:21.169243 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87437e-7211-4e82-a013-fb2d0a199819 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:21.169622 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87437e-7211-4e82-a013-fb2d0a199819 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:21.169998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87437e-7211-4e82-a013-fb2d0a199819 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:21.179944 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87437e-7211-4e82-a013-fb2d0a199819 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:21.181511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87437e-7211-4e82-a013-fb2d0a199819 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:21.192470 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1259/2526] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:21 2021] GET /identity/v3/auth/tokens => generated 3411 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:28.650392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072b1af-fdde-4688-b902-ad703cb9daec None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:28.651813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f072b1af-fdde-4688-b902-ad703cb9daec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:28.707850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f072b1af-fdde-4688-b902-ad703cb9daec None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:28.711435 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:28.712077 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:28.712355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:28.712625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:28.714393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:28.775353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:28.776804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:28.786872 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1268/2527] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:28 2021] GET /identity/v3/auth/tokens => generated 3458 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:38.166170 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e0c0b-b3a0-46f7-b0bd-105125c15084 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:38.166680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e0c0b-b3a0-46f7-b0bd-105125c15084 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:38.166680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29e0c0b-b3a0-46f7-b0bd-105125c15084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:38.184270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f29e0c0b-b3a0-46f7-b0bd-105125c15084 None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:38.185545 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f29e0c0b-b3a0-46f7-b0bd-105125c15084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:38.238834 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1260/2528] 10.222.0.32 () {58 vars in 967 bytes} [Wed Oct 27 01:25:38 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:38.251788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:38.253136 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:38.320690 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be0a49-d2e0-4a90-832c-9f0043fa4415 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:38.325616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3451d3a-ec54-4dd6-b679-f075efc4b8f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:38.326287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3451d3a-ec54-4dd6-b679-f075efc4b8f9 service swift] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:38.327145 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3451d3a-ec54-4dd6-b679-f075efc4b8f9 service swift] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:38.327600 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3451d3a-ec54-4dd6-b679-f075efc4b8f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:38.335668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3451d3a-ec54-4dd6-b679-f075efc4b8f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:38.337239 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3451d3a-ec54-4dd6-b679-f075efc4b8f9 service swift] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:38.346285 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1269/2529] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:25:38 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:25:42.588043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e0c0b-b3a0-46f7-b0bd-105125c15084 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:42.650756 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29e0c0b-b3a0-46f7-b0bd-105125c15084 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:42.655941 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:42.656807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:42.657081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:42.657350 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] PATH_INFO: `/v3/users/8568823cd18147a2833b3778454b601d` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:42.658585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8568823cd18147a2833b3778454b601d)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:42.660506 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:42.860572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8568823cd18147a2833b3778454b601d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.875579 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8568823cd18147a2833b3778454b601d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.884463 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8568823cd18147a2833b3778454b601d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.885408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8568823cd18147a2833b3778454b601d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.946349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8568823cd18147a2833b3778454b601d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:42.948204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1261/2530] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:25:42 2021] DELETE /identity/v3/users/8568823cd18147a2833b3778454b601d => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:42.953368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebb1de-5e73-49ea-a512-ea863e81f774 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:42.953838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebb1de-5e73-49ea-a512-ea863e81f774 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:42.954015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebb1de-5e73-49ea-a512-ea863e81f774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:42.971565 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5cebb1de-5e73-49ea-a512-ea863e81f774 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:42.972737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5cebb1de-5e73-49ea-a512-ea863e81f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:43.033449 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1270/2531] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:42 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:43.044187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.045748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:43.102089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf7cd3-df32-4214-9f8d-2f5bfe3e85d5 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.105623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a051d5a-f4f0-470c-9a00-310cbcf80b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.106295 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a051d5a-f4f0-470c-9a00-310cbcf80b54 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.106572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a051d5a-f4f0-470c-9a00-310cbcf80b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.106840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a051d5a-f4f0-470c-9a00-310cbcf80b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.115906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a051d5a-f4f0-470c-9a00-310cbcf80b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.117313 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a051d5a-f4f0-470c-9a00-310cbcf80b54 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.126838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1262/2532] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:43 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:43.555190 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebb1de-5e73-49ea-a512-ea863e81f774 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:43.556868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5cebb1de-5e73-49ea-a512-ea863e81f774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:43.569594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebb1de-5e73-49ea-a512-ea863e81f774 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:43.575013 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:43.575950 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.576363 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.576709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] PATH_INFO: `/v3/projects/88b3d604c12c4ce0969ee220c7e93df1` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.578147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b3d604c12c4ce0969ee220c7e93df1)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:43.580147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:43.756520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b3d604c12c4ce0969ee220c7e93df1', 'request_id': 'req-e88fd11c-f4cb-45a7-8277-e23e275248cd'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.763080 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b3d604c12c4ce0969ee220c7e93df1', 'request_id': 'req-e88fd11c-f4cb-45a7-8277-e23e275248cd'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.769621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b3d604c12c4ce0969ee220c7e93df1', 'request_id': 'req-e88fd11c-f4cb-45a7-8277-e23e275248cd'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.861504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] The token cache is being invalidate because project 88b3d604c12c4ce0969ee220c7e93df1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:43.861711 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.862499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e88fd11c-f4cb-45a7-8277-e23e275248cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:43.864424 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1271/2533] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:25:43 2021] DELETE /identity/v3/projects/88b3d604c12c4ce0969ee220c7e93df1 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:43.870134 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ad284-584a-48bc-b3e7-80d3b0997c6c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.870637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ad284-584a-48bc-b3e7-80d3b0997c6c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.870733 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ad284-584a-48bc-b3e7-80d3b0997c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.890753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8a1ad284-584a-48bc-b3e7-80d3b0997c6c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:43.891965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8a1ad284-584a-48bc-b3e7-80d3b0997c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:43.951471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1263/2534] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:43.959229 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bf9b-2b06-4bbb-b73f-ed1fb814ba65 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:43.959696 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bf9b-2b06-4bbb-b73f-ed1fb814ba65 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:43.959805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19bf9b-2b06-4bbb-b73f-ed1fb814ba65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:43.987463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-5c19bf9b-2b06-4bbb-b73f-ed1fb814ba65 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:43.987463 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5c19bf9b-2b06-4bbb-b73f-ed1fb814ba65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:44.001086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1272/2535] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:43 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:44.006564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ad284-584a-48bc-b3e7-80d3b0997c6c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.017730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ad284-584a-48bc-b3e7-80d3b0997c6c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.022536 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8b3e-219f-471c-ac1b-bfd03a702a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.023865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8b3e-219f-471c-ac1b-bfd03a702a7e admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.024223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8b3e-219f-471c-ac1b-bfd03a702a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.024561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb8b3e-219f-471c-ac1b-bfd03a702a7e admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.025371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8b3e-219f-471c-ac1b-bfd03a702a7e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:44.025742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8b3e-219f-471c-ac1b-bfd03a702a7e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.027547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb8b3e-219f-471c-ac1b-bfd03a702a7e admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.040647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1264/2536] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:25:44 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:44.045720 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bf9b-2b06-4bbb-b73f-ed1fb814ba65 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.059913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19bf9b-2b06-4bbb-b73f-ed1fb814ba65 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.069094 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d90964-654a-48d5-85a9-1eab735b4262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.069753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d90964-654a-48d5-85a9-1eab735b4262 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.070050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d90964-654a-48d5-85a9-1eab735b4262 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.070332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d90964-654a-48d5-85a9-1eab735b4262 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.071050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d90964-654a-48d5-85a9-1eab735b4262 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.073062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d90964-654a-48d5-85a9-1eab735b4262 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.189008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1273/2537] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:44 2021] POST /identity/v3/projects => generated 377 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:44.193242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8b3e-219f-471c-ac1b-bfd03a702a7e admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.203734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb8b3e-219f-471c-ac1b-bfd03a702a7e admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.260007 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ce22f-d685-4442-ad49-50c4e9a1e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.260685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ce22f-d685-4442-ad49-50c4e9a1e89f admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.260967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ce22f-d685-4442-ad49-50c4e9a1e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.261242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ce22f-d685-4442-ad49-50c4e9a1e89f admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.261940 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ce22f-d685-4442-ad49-50c4e9a1e89f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.264712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ce22f-d685-4442-ad49-50c4e9a1e89f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.420955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1265/2538] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:44 2021] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:44.421320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d90964-654a-48d5-85a9-1eab735b4262 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.431961 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d90964-654a-48d5-85a9-1eab735b4262 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.437327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c87fd-2b37-4744-b44b-b5620a0c834c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.437995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c87fd-2b37-4744-b44b-b5620a0c834c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.438305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c87fd-2b37-4744-b44b-b5620a0c834c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.438584 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5c87fd-2b37-4744-b44b-b5620a0c834c admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.439326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c87fd-2b37-4744-b44b-b5620a0c834c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.440923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5c87fd-2b37-4744-b44b-b5620a0c834c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.451276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1274/2539] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:44.457626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ce22f-d685-4442-ad49-50c4e9a1e89f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.468220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ce22f-d685-4442-ad49-50c4e9a1e89f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.473109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202febfd-883a-452a-8235-1a5945c1f59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.473913 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202febfd-883a-452a-8235-1a5945c1f59a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.474095 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202febfd-883a-452a-8235-1a5945c1f59a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.474378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202febfd-883a-452a-8235-1a5945c1f59a admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.475119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202febfd-883a-452a-8235-1a5945c1f59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.476952 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202febfd-883a-452a-8235-1a5945c1f59a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.488644 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1266/2540] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:44 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:44.492662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c87fd-2b37-4744-b44b-b5620a0c834c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.503502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5c87fd-2b37-4744-b44b-b5620a0c834c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.508316 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64a55-e485-4334-81d8-25292e84bec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.509204 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64a55-e485-4334-81d8-25292e84bec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.509486 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64a55-e485-4334-81d8-25292e84bec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.509757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff64a55-e485-4334-81d8-25292e84bec2 admin admin] PATH_INFO: `/v3/projects/80ccd2038569468b9d4f7a063fb346c9/users/eb7fe651d1c84f28a9267a543d0e2497/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.525701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff64a55-e485-4334-81d8-25292e84bec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80ccd2038569468b9d4f7a063fb346c9, user_id=eb7fe651d1c84f28a9267a543d0e2497, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.528425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff64a55-e485-4334-81d8-25292e84bec2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.661789 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1275/2541] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:44 2021] PUT /identity/v3/projects/80ccd2038569468b9d4f7a063fb346c9/users/eb7fe651d1c84f28a9267a543d0e2497/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:44.667133 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4adb8-67e9-4208-94b6-192700762cab None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.667424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4adb8-67e9-4208-94b6-192700762cab None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.667699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4adb8-67e9-4208-94b6-192700762cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.685961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-4cd4adb8-67e9-4208-94b6-192700762cab None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:44.690643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4cd4adb8-67e9-4208-94b6-192700762cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:44.751537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1267/2542] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:44.762069 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64a55-e485-4334-81d8-25292e84bec2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:44.764374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9ff64a55-e485-4334-81d8-25292e84bec2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:44.833829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff64a55-e485-4334-81d8-25292e84bec2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:44.837520 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b633451-c3bc-46ea-b0f0-2feb24a7c36d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:44.838192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b633451-c3bc-46ea-b0f0-2feb24a7c36d service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:44.838472 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b633451-c3bc-46ea-b0f0-2feb24a7c36d service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:44.838743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b633451-c3bc-46ea-b0f0-2feb24a7c36d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:44.847542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b633451-c3bc-46ea-b0f0-2feb24a7c36d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:44.848943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b633451-c3bc-46ea-b0f0-2feb24a7c36d service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:44.858567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1276/2543] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:44 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:50.057651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4adb8-67e9-4208-94b6-192700762cab None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:50.059732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4cd4adb8-67e9-4208-94b6-192700762cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:50.076015 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4adb8-67e9-4208-94b6-192700762cab None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:50.080421 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad8946-9ea9-4445-8c1a-c1bb947b921c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:50.081285 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad8946-9ea9-4445-8c1a-c1bb947b921c service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:50.081748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad8946-9ea9-4445-8c1a-c1bb947b921c service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:50.082712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad8946-9ea9-4445-8c1a-c1bb947b921c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:50.084875 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-65ad8946-9ea9-4445-8c1a-c1bb947b921c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:50.110969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad8946-9ea9-4445-8c1a-c1bb947b921c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:50.112615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad8946-9ea9-4445-8c1a-c1bb947b921c service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:50.132043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1268/2544] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:50 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:50.334685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09dcd-d1ea-49a5-bd00-de8f0f2be1dd None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:50.335539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09dcd-d1ea-49a5-bd00-de8f0f2be1dd None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:50.335972 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a09dcd-d1ea-49a5-bd00-de8f0f2be1dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:50.397243 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-50a09dcd-d1ea-49a5-bd00-de8f0f2be1dd None None] MFA Rules not processed for user `eb7fe651d1c84f28a9267a543d0e2497`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:50.398537 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-50a09dcd-d1ea-49a5-bd00-de8f0f2be1dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:50.484261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1277/2545] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:50 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:25:50.489300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad8946-9ea9-4445-8c1a-c1bb947b921c service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:50.500766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad8946-9ea9-4445-8c1a-c1bb947b921c service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:50.505436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390469e-4c07-4ce1-afad-5f3f10f971b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:50.506142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390469e-4c07-4ce1-afad-5f3f10f971b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:50.506457 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390469e-4c07-4ce1-afad-5f3f10f971b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:50.506730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390469e-4c07-4ce1-afad-5f3f10f971b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:50.507433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390469e-4c07-4ce1-afad-5f3f10f971b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:50.509604 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390469e-4c07-4ce1-afad-5f3f10f971b4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:50.634436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1269/2546] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:50 2021] POST /identity/v3/projects => generated 377 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:50.638905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a09dcd-d1ea-49a5-bd00-de8f0f2be1dd None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:50.651277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a09dcd-d1ea-49a5-bd00-de8f0f2be1dd None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:50.710328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc8f9-f835-4bb9-adff-4bda17e9fca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:50.711004 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc8f9-f835-4bb9-adff-4bda17e9fca4 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:50.711285 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc8f9-f835-4bb9-adff-4bda17e9fca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:50.711546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdc8f9-f835-4bb9-adff-4bda17e9fca4 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:50.712456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc8f9-f835-4bb9-adff-4bda17e9fca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:50.714390 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdc8f9-f835-4bb9-adff-4bda17e9fca4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:50.833487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1278/2547] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:50 2021] POST /identity/v3/users => generated 295 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:50.837743 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390469e-4c07-4ce1-afad-5f3f10f971b4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:50.849957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390469e-4c07-4ce1-afad-5f3f10f971b4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:50.860320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73b477-ed60-4c60-9648-f3d8aa89d82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:50.861304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73b477-ed60-4c60-9648-f3d8aa89d82f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:50.861859 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73b477-ed60-4c60-9648-f3d8aa89d82f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:50.862346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c73b477-ed60-4c60-9648-f3d8aa89d82f admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:50.863401 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73b477-ed60-4c60-9648-f3d8aa89d82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:50.865434 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c73b477-ed60-4c60-9648-f3d8aa89d82f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:50.878432 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1270/2548] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:50 2021] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:50.882648 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc8f9-f835-4bb9-adff-4bda17e9fca4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:50.893740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdc8f9-f835-4bb9-adff-4bda17e9fca4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:50.899333 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb09d3-b9d3-4312-b058-13c57b94a19e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:50.900381 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb09d3-b9d3-4312-b058-13c57b94a19e admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:50.900735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb09d3-b9d3-4312-b058-13c57b94a19e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:50.901595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb09d3-b9d3-4312-b058-13c57b94a19e admin admin] PATH_INFO: `/v3/projects/b39641b3f9f54f608fa97e28dd1aa1fd/users/fed43b17626b4031999d65ac4840f079/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:50.925716 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb09d3-b9d3-4312-b058-13c57b94a19e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39641b3f9f54f608fa97e28dd1aa1fd, user_id=fed43b17626b4031999d65ac4840f079, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:50.929031 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb09d3-b9d3-4312-b058-13c57b94a19e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:51.010481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1279/2549] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:50 2021] PUT /identity/v3/projects/b39641b3f9f54f608fa97e28dd1aa1fd/users/fed43b17626b4031999d65ac4840f079/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:51.018157 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73b477-ed60-4c60-9648-f3d8aa89d82f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:51.028484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c73b477-ed60-4c60-9648-f3d8aa89d82f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:51.091549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9f157-0114-4882-8470-045364faf67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:51.092905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9f157-0114-4882-8470-045364faf67d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:51.093283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9f157-0114-4882-8470-045364faf67d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:51.093651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9f157-0114-4882-8470-045364faf67d admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:51.094530 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9f157-0114-4882-8470-045364faf67d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:51.096355 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9f157-0114-4882-8470-045364faf67d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:51.107554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1271/2550] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:51 2021] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:51.112191 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb09d3-b9d3-4312-b058-13c57b94a19e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:51.124006 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb09d3-b9d3-4312-b058-13c57b94a19e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:51.129748 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277656b4-bf8c-4b93-9ca2-48a31da1aef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:51.130715 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277656b4-bf8c-4b93-9ca2-48a31da1aef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:51.130993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277656b4-bf8c-4b93-9ca2-48a31da1aef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:51.131323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277656b4-bf8c-4b93-9ca2-48a31da1aef7 admin admin] PATH_INFO: `/v3/projects/b39641b3f9f54f608fa97e28dd1aa1fd/users/fed43b17626b4031999d65ac4840f079/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:51.134070 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277656b4-bf8c-4b93-9ca2-48a31da1aef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39641b3f9f54f608fa97e28dd1aa1fd, user_id=fed43b17626b4031999d65ac4840f079, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:51.136745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277656b4-bf8c-4b93-9ca2-48a31da1aef7 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:51.149526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1280/2551] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:51 2021] PUT /identity/v3/projects/b39641b3f9f54f608fa97e28dd1aa1fd/users/fed43b17626b4031999d65ac4840f079/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:25:54.838395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9f157-0114-4882-8470-045364faf67d admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:54.840537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-cee9f157-0114-4882-8470-045364faf67d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:54.862627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9f157-0114-4882-8470-045364faf67d admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:54.949047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:54.951231 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:54.951587 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:54.952653 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] PATH_INFO: `/v3/users/e97b78644a8046da928880c62b18253d` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:54.954241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] RBAC: Authorizing `identity:delete_user(user_id=e97b78644a8046da928880c62b18253d)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:54.956466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:55.155332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e97b78644a8046da928880c62b18253d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:55.167628 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e97b78644a8046da928880c62b18253d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:55.175607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e97b78644a8046da928880c62b18253d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:55.176375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e97b78644a8046da928880c62b18253d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:55.255862 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c847928c-2241-4f0b-a76b-83145c1ea2df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e97b78644a8046da928880c62b18253d'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:55.267133 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1272/2552] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:25:54 2021] DELETE /identity/v3/users/e97b78644a8046da928880c62b18253d => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:55.595735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277656b4-bf8c-4b93-9ca2-48a31da1aef7 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:55.597502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-277656b4-bf8c-4b93-9ca2-48a31da1aef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:55.621960 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277656b4-bf8c-4b93-9ca2-48a31da1aef7 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:55.724170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:55.725693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:55.726227 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:55.726704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] PATH_INFO: `/v3/projects/ba4a231d73f5454eb53e08db96f0a471` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:55.728315 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba4a231d73f5454eb53e08db96f0a471)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:55.730583 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:55.876194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba4a231d73f5454eb53e08db96f0a471', 'request_id': 'req-415bbda2-ed04-4d35-b56f-af9a34763207'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:55.905981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba4a231d73f5454eb53e08db96f0a471', 'request_id': 'req-415bbda2-ed04-4d35-b56f-af9a34763207'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:55.933762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba4a231d73f5454eb53e08db96f0a471', 'request_id': 'req-415bbda2-ed04-4d35-b56f-af9a34763207'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:56.016278 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] The token cache is being invalidate because project ba4a231d73f5454eb53e08db96f0a471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:25:56.016639 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:56.017364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-415bbda2-ed04-4d35-b56f-af9a34763207 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:25:56.025661 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3247-d292-4961-bb46-3e132a7d2084 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.030611 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1281/2553] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:25:55 2021] DELETE /identity/v3/projects/ba4a231d73f5454eb53e08db96f0a471 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:56.030753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3247-d292-4961-bb46-3e132a7d2084 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.030753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f3247-d292-4961-bb46-3e132a7d2084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.053984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2f7f3247-d292-4961-bb46-3e132a7d2084 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:56.055890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2f7f3247-d292-4961-bb46-3e132a7d2084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:56.200640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1273/2554] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:56.208473 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3eb0-9d29-4d08-a0a5-d66bb7687d01 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.208768 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3eb0-9d29-4d08-a0a5-d66bb7687d01 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.209026 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c3eb0-9d29-4d08-a0a5-d66bb7687d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.241016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-a32c3eb0-9d29-4d08-a0a5-d66bb7687d01 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:56.242518 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a32c3eb0-9d29-4d08-a0a5-d66bb7687d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:56.267259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3247-d292-4961-bb46-3e132a7d2084 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:56.267771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1282/2555] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:56 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:56.284855 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f3247-d292-4961-bb46-3e132a7d2084 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:56.291438 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2aa956-7874-4514-a840-e906c7c75cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:56.293179 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2aa956-7874-4514-a840-e906c7c75cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.293651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2aa956-7874-4514-a840-e906c7c75cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.294096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2aa956-7874-4514-a840-e906c7c75cb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.295116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2aa956-7874-4514-a840-e906c7c75cb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:25:56.295582 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2aa956-7874-4514-a840-e906c7c75cb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:56.297341 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2aa956-7874-4514-a840-e906c7c75cb0 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:56.329807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1274/2556] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:25:56 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:25:56.334599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c3eb0-9d29-4d08-a0a5-d66bb7687d01 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:56.349643 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c3eb0-9d29-4d08-a0a5-d66bb7687d01 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:56.358786 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fcd5a-40ce-4401-a48a-3ddfbcda9497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:56.359460 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fcd5a-40ce-4401-a48a-3ddfbcda9497 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.359734 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fcd5a-40ce-4401-a48a-3ddfbcda9497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.360005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595fcd5a-40ce-4401-a48a-3ddfbcda9497 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.361349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fcd5a-40ce-4401-a48a-3ddfbcda9497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:56.363348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595fcd5a-40ce-4401-a48a-3ddfbcda9497 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:56.651854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1283/2557] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:56 2021] POST /identity/v3/projects => generated 403 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:56.656836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2aa956-7874-4514-a840-e906c7c75cb0 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:56.666777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2aa956-7874-4514-a840-e906c7c75cb0 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:56.761651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff3234-e82c-4a6f-955c-5745f62e64f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:56.762686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff3234-e82c-4a6f-955c-5745f62e64f1 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.763261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff3234-e82c-4a6f-955c-5745f62e64f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.763946 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff3234-e82c-4a6f-955c-5745f62e64f1 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.765395 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff3234-e82c-4a6f-955c-5745f62e64f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:56.768533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff3234-e82c-4a6f-955c-5745f62e64f1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:56.862705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1275/2558] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:56 2021] POST /identity/v3/users => generated 302 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:56.866546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fcd5a-40ce-4401-a48a-3ddfbcda9497 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:56.877259 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595fcd5a-40ce-4401-a48a-3ddfbcda9497 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:56.883447 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52228a16-2f0d-447a-aff9-9b860cf95883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:56.884675 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228a16-2f0d-447a-aff9-9b860cf95883 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.885182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228a16-2f0d-447a-aff9-9b860cf95883 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.885561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52228a16-2f0d-447a-aff9-9b860cf95883 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.886475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52228a16-2f0d-447a-aff9-9b860cf95883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:56.888321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52228a16-2f0d-447a-aff9-9b860cf95883 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:56.901871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1284/2559] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:25:56.908757 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff3234-e82c-4a6f-955c-5745f62e64f1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:56.921808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff3234-e82c-4a6f-955c-5745f62e64f1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:56.927540 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35df5e5-7fe4-4dbb-a38b-0d457381d4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:56.928226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df5e5-7fe4-4dbb-a38b-0d457381d4ec admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.928679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df5e5-7fe4-4dbb-a38b-0d457381d4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.929013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35df5e5-7fe4-4dbb-a38b-0d457381d4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.929681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df5e5-7fe4-4dbb-a38b-0d457381d4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:56.931518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35df5e5-7fe4-4dbb-a38b-0d457381d4ec admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:56.943703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1276/2560] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:56 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:56.947920 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52228a16-2f0d-447a-aff9-9b860cf95883 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:56.959911 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52228a16-2f0d-447a-aff9-9b860cf95883 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:56.967138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90021a7b-7d49-4846-bcd2-6c9becca905b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:56.968504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90021a7b-7d49-4846-bcd2-6c9becca905b admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:56.969049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90021a7b-7d49-4846-bcd2-6c9becca905b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:56.969409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90021a7b-7d49-4846-bcd2-6c9becca905b admin admin] PATH_INFO: `/v3/projects/4124a85f3d4f492da522988ff7f07873/users/4ed7549d082f4a0ba2e28bbd9fc2672c/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:56.985411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90021a7b-7d49-4846-bcd2-6c9becca905b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4124a85f3d4f492da522988ff7f07873, user_id=4ed7549d082f4a0ba2e28bbd9fc2672c, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:56.988304 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90021a7b-7d49-4846-bcd2-6c9becca905b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:57.066175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70686695-29bf-4eb9-9c45-aca643cde0d0 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:57.066175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70686695-29bf-4eb9-9c45-aca643cde0d0 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:57.066175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70686695-29bf-4eb9-9c45-aca643cde0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:57.067087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1285/2561] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:56 2021] PUT /identity/v3/projects/4124a85f3d4f492da522988ff7f07873/users/4ed7549d082f4a0ba2e28bbd9fc2672c/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:57.088931 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-70686695-29bf-4eb9-9c45-aca643cde0d0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:57.090173 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-70686695-29bf-4eb9-9c45-aca643cde0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:57.162310 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1277/2562] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:57.174226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90021a7b-7d49-4846-bcd2-6c9becca905b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:57.176017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-90021a7b-7d49-4846-bcd2-6c9becca905b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:57.240623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90021a7b-7d49-4846-bcd2-6c9becca905b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:57.244685 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f7551-61a6-42dd-bc8f-2a12aa3db002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:57.245330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f7551-61a6-42dd-bc8f-2a12aa3db002 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:57.245612 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f7551-61a6-42dd-bc8f-2a12aa3db002 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:57.245885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0f7551-61a6-42dd-bc8f-2a12aa3db002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:57.259291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f7551-61a6-42dd-bc8f-2a12aa3db002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:57.261570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0f7551-61a6-42dd-bc8f-2a12aa3db002 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:57.272880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1286/2563] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:25:57.863091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38053e83-4bca-491e-8dad-ab069cab9aed None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:57.863091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38053e83-4bca-491e-8dad-ab069cab9aed None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:57.863091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38053e83-4bca-491e-8dad-ab069cab9aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:57.894578 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-38053e83-4bca-491e-8dad-ab069cab9aed None None] MFA Rules not processed for user `fed43b17626b4031999d65ac4840f079`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:57.895887 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-38053e83-4bca-491e-8dad-ab069cab9aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:58.007608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1278/2564] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:57 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:58.020909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f7551-61a6-42dd-bc8f-2a12aa3db002 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:58.023129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-5f0f7551-61a6-42dd-bc8f-2a12aa3db002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:58.111598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0f7551-61a6-42dd-bc8f-2a12aa3db002 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:58.119546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed09f37-7d04-4a1b-90be-36dc6deeabbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:58.120535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed09f37-7d04-4a1b-90be-36dc6deeabbc service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:58.120821 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed09f37-7d04-4a1b-90be-36dc6deeabbc service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:58.121093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed09f37-7d04-4a1b-90be-36dc6deeabbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:58.123567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-bed09f37-7d04-4a1b-90be-36dc6deeabbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:58.206880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed09f37-7d04-4a1b-90be-36dc6deeabbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:58.208984 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed09f37-7d04-4a1b-90be-36dc6deeabbc service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:58.221665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1287/2565] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:25:58 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:25:58.780098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723e32e-e90b-4dc4-8901-13b8c2aa67b8 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:58.780098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723e32e-e90b-4dc4-8901-13b8c2aa67b8 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:58.780098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8723e32e-e90b-4dc4-8901-13b8c2aa67b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:58.813868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-8723e32e-e90b-4dc4-8901-13b8c2aa67b8 None None] MFA Rules not processed for user `4ed7549d082f4a0ba2e28bbd9fc2672c`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:25:58.815113 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8723e32e-e90b-4dc4-8901-13b8c2aa67b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:25:58.885639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1279/2566] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:25:58 2021] POST /identity/v3/auth/tokens => generated 3423 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:25:58.890487 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed09f37-7d04-4a1b-90be-36dc6deeabbc service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:58.907985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed09f37-7d04-4a1b-90be-36dc6deeabbc service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:58.916408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24305b2-1d41-4014-b2e7-b89a7d1ddcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:58.917113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24305b2-1d41-4014-b2e7-b89a7d1ddcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:58.917392 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24305b2-1d41-4014-b2e7-b89a7d1ddcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:58.917665 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24305b2-1d41-4014-b2e7-b89a7d1ddcd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:58.918439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24305b2-1d41-4014-b2e7-b89a7d1ddcd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:58.922831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24305b2-1d41-4014-b2e7-b89a7d1ddcd3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:59.045940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1288/2567] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:25:58 2021] POST /identity/v3/projects => generated 405 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:25:59.049924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723e32e-e90b-4dc4-8901-13b8c2aa67b8 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:59.061235 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8723e32e-e90b-4dc4-8901-13b8c2aa67b8 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:59.126886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa550a01-e15b-473c-9244-b06187ee2bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:59.127566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa550a01-e15b-473c-9244-b06187ee2bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:59.128321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa550a01-e15b-473c-9244-b06187ee2bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:59.128596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa550a01-e15b-473c-9244-b06187ee2bd6 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:59.129325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa550a01-e15b-473c-9244-b06187ee2bd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:59.131229 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa550a01-e15b-473c-9244-b06187ee2bd6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:59.209930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1280/2568] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:25:59 2021] POST /identity/v3/users => generated 309 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:25:59.214124 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24305b2-1d41-4014-b2e7-b89a7d1ddcd3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:59.224294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24305b2-1d41-4014-b2e7-b89a7d1ddcd3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:59.229390 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e3095-bda1-4027-9168-71ee18cc002d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:59.230163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3095-bda1-4027-9168-71ee18cc002d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:59.230510 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3095-bda1-4027-9168-71ee18cc002d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:59.230880 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879e3095-bda1-4027-9168-71ee18cc002d admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:59.231936 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e3095-bda1-4027-9168-71ee18cc002d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:59.233954 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879e3095-bda1-4027-9168-71ee18cc002d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:59.245857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1289/2569] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:59 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:59.250811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa550a01-e15b-473c-9244-b06187ee2bd6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:59.264305 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa550a01-e15b-473c-9244-b06187ee2bd6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:59.277921 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3472b1b-3afb-4593-8399-b78bb07e0df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:59.279020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3472b1b-3afb-4593-8399-b78bb07e0df3 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:59.279298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3472b1b-3afb-4593-8399-b78bb07e0df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:59.279657 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3472b1b-3afb-4593-8399-b78bb07e0df3 admin admin] PATH_INFO: `/v3/projects/5a10932e5fd541109164ab1ff99d2693/users/9da6b4d980e9448db1605bd517808142/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:59.294896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3472b1b-3afb-4593-8399-b78bb07e0df3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a10932e5fd541109164ab1ff99d2693, user_id=9da6b4d980e9448db1605bd517808142, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:59.297572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3472b1b-3afb-4593-8399-b78bb07e0df3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:59.393402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1281/2570] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:59 2021] PUT /identity/v3/projects/5a10932e5fd541109164ab1ff99d2693/users/9da6b4d980e9448db1605bd517808142/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:25:59.397455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e3095-bda1-4027-9168-71ee18cc002d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:59.407515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879e3095-bda1-4027-9168-71ee18cc002d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:59.481099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7f10ec-e66f-4403-a3f5-d7c00e3db1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:59.482841 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f10ec-e66f-4403-a3f5-d7c00e3db1cb admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:59.483115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f10ec-e66f-4403-a3f5-d7c00e3db1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:59.486254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7f10ec-e66f-4403-a3f5-d7c00e3db1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:59.486254 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f10ec-e66f-4403-a3f5-d7c00e3db1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:59.486940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7f10ec-e66f-4403-a3f5-d7c00e3db1cb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:59.498667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1290/2571] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:25:59 2021] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:25:59.502825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3472b1b-3afb-4593-8399-b78bb07e0df3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:25:59.515130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3472b1b-3afb-4593-8399-b78bb07e0df3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:25:59.519971 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949d733-c9fa-4084-8fce-36bf850cc0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:25:59.520877 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949d733-c9fa-4084-8fce-36bf850cc0f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:25:59.521155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949d733-c9fa-4084-8fce-36bf850cc0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:25:59.521425 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d949d733-c9fa-4084-8fce-36bf850cc0f1 admin admin] PATH_INFO: `/v3/projects/5a10932e5fd541109164ab1ff99d2693/users/9da6b4d980e9448db1605bd517808142/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:25:59.523443 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949d733-c9fa-4084-8fce-36bf850cc0f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a10932e5fd541109164ab1ff99d2693, user_id=9da6b4d980e9448db1605bd517808142, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:25:59.526047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d949d733-c9fa-4084-8fce-36bf850cc0f1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:25:59.537618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1282/2572] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:25:59 2021] PUT /identity/v3/projects/5a10932e5fd541109164ab1ff99d2693/users/9da6b4d980e9448db1605bd517808142/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:26:01.274885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd447e-9d43-47d5-ae06-fe905f3991c2 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:01.275729 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd447e-9d43-47d5-ae06-fe905f3991c2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:01.276210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecd447e-9d43-47d5-ae06-fe905f3991c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:01.306664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-cecd447e-9d43-47d5-ae06-fe905f3991c2 None None] MFA Rules not processed for user `9da6b4d980e9448db1605bd517808142`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:01.307642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-cecd447e-9d43-47d5-ae06-fe905f3991c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:01.402267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1291/2573] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:01 2021] POST /identity/v3/auth/tokens => generated 3492 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:02.860380 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949d733-c9fa-4084-8fce-36bf850cc0f1 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:02.924335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d949d733-c9fa-4084-8fce-36bf850cc0f1 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:02.928947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:02.929803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:02.930132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:02.930399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] PATH_INFO: `/v3/users/4ed7549d082f4a0ba2e28bbd9fc2672c` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:02.931607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ed7549d082f4a0ba2e28bbd9fc2672c)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:02.933496 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:03.128995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ed7549d082f4a0ba2e28bbd9fc2672c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.140664 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ed7549d082f4a0ba2e28bbd9fc2672c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.147086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ed7549d082f4a0ba2e28bbd9fc2672c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.147755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ed7549d082f4a0ba2e28bbd9fc2672c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.260980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ed7549d082f4a0ba2e28bbd9fc2672c'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.267813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1283/2574] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:02 2021] DELETE /identity/v3/users/4ed7549d082f4a0ba2e28bbd9fc2672c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:03.540837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd447e-9d43-47d5-ae06-fe905f3991c2 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:03.561859 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecd447e-9d43-47d5-ae06-fe905f3991c2 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:03.618346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:03.619223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:03.619499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:03.619800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] PATH_INFO: `/v3/projects/4124a85f3d4f492da522988ff7f07873` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:03.621010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4124a85f3d4f492da522988ff7f07873)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:03.623521 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:03.724224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4124a85f3d4f492da522988ff7f07873', 'request_id': 'req-e65e143b-8ab4-4635-9c6a-0d6104702ccb'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.732165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4124a85f3d4f492da522988ff7f07873', 'request_id': 'req-e65e143b-8ab4-4635-9c6a-0d6104702ccb'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.737679 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4124a85f3d4f492da522988ff7f07873', 'request_id': 'req-e65e143b-8ab4-4635-9c6a-0d6104702ccb'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.826762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] The token cache is being invalidate because project 4124a85f3d4f492da522988ff7f07873 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:03.827046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.827693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:03.829235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1292/2575] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:03 2021] DELETE /identity/v3/projects/4124a85f3d4f492da522988ff7f07873 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:03.833187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:03.834573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:03.847656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7544f32-2315-4f42-93df-a93f679ad202 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:03.904254 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:03.905297 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:03.905583 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:03.905853 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] PATH_INFO: `/v3/users/9da6b4d980e9448db1605bd517808142` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:03.907090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=9da6b4d980e9448db1605bd517808142)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:03.908977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:04.055819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9da6b4d980e9448db1605bd517808142'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.067840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9da6b4d980e9448db1605bd517808142'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.074517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9da6b4d980e9448db1605bd517808142'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.075216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9da6b4d980e9448db1605bd517808142'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.151902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-89b8b17e-e909-40a3-9c47-491f3b009daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9da6b4d980e9448db1605bd517808142'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.158865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1284/2576] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:03 2021] DELETE /identity/v3/users/9da6b4d980e9448db1605bd517808142 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:04.467526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:04.469005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:04.483686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e143b-8ab4-4635-9c6a-0d6104702ccb admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:04.538166 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:04.539034 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:04.539285 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:04.539550 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] PATH_INFO: `/v3/projects/5a10932e5fd541109164ab1ff99d2693` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:04.540707 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a10932e5fd541109164ab1ff99d2693)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:04.542662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:04.660916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a10932e5fd541109164ab1ff99d2693', 'request_id': 'req-7b2acb1c-a0c5-441d-9dc9-d176b60025df'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.666967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a10932e5fd541109164ab1ff99d2693', 'request_id': 'req-7b2acb1c-a0c5-441d-9dc9-d176b60025df'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.672564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a10932e5fd541109164ab1ff99d2693', 'request_id': 'req-7b2acb1c-a0c5-441d-9dc9-d176b60025df'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.774430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] The token cache is being invalidate because project 5a10932e5fd541109164ab1ff99d2693 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:04.774644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.775218 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-7b2acb1c-a0c5-441d-9dc9-d176b60025df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:04.776747 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1293/2577] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:04 2021] DELETE /identity/v3/projects/5a10932e5fd541109164ab1ff99d2693 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:04.783086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ce149-1e5b-45a1-bbe2-ed9d0828aa46 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:04.783368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ce149-1e5b-45a1-bbe2-ed9d0828aa46 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:04.783639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ce149-1e5b-45a1-bbe2-ed9d0828aa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:04.800692 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-6b2ce149-1e5b-45a1-bbe2-ed9d0828aa46 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:04.801863 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6b2ce149-1e5b-45a1-bbe2-ed9d0828aa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:04.859778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1285/2578] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:04.867444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5a505-a8a5-4653-98e2-1d64f8be8e26 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:04.867738 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5a505-a8a5-4653-98e2-1d64f8be8e26 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:04.868017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5a505-a8a5-4653-98e2-1d64f8be8e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:04.885995 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-ecb5a505-a8a5-4653-98e2-1d64f8be8e26 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:04.887240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ecb5a505-a8a5-4653-98e2-1d64f8be8e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:04.896172 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1294/2579] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:04 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:04.900349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ce149-1e5b-45a1-bbe2-ed9d0828aa46 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:04.910724 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ce149-1e5b-45a1-bbe2-ed9d0828aa46 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:04.915323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ec603-7fff-43eb-80f6-21a1e0bc49ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:04.915960 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ec603-7fff-43eb-80f6-21a1e0bc49ee admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:04.916238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ec603-7fff-43eb-80f6-21a1e0bc49ee admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:04.916508 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ec603-7fff-43eb-80f6-21a1e0bc49ee admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:04.917232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ec603-7fff-43eb-80f6-21a1e0bc49ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:04.917533 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ec603-7fff-43eb-80f6-21a1e0bc49ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:04.919193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ec603-7fff-43eb-80f6-21a1e0bc49ee admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:04.930546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1286/2580] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:26:04 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:04.934630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5a505-a8a5-4653-98e2-1d64f8be8e26 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:04.944159 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5a505-a8a5-4653-98e2-1d64f8be8e26 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:04.948813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7d37b-bed6-4b64-8c3e-2f75d2120ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:04.949455 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7d37b-bed6-4b64-8c3e-2f75d2120ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:04.949795 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7d37b-bed6-4b64-8c3e-2f75d2120ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:04.950125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7d37b-bed6-4b64-8c3e-2f75d2120ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:04.951352 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7d37b-bed6-4b64-8c3e-2f75d2120ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:04.953226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7d37b-bed6-4b64-8c3e-2f75d2120ef8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:05.080074 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1295/2581] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:04 2021] POST /identity/v3/projects => generated 365 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:05.084163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ec603-7fff-43eb-80f6-21a1e0bc49ee admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:05.094143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ec603-7fff-43eb-80f6-21a1e0bc49ee admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:05.149433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db07eb-0a74-41f3-b3ae-7177655993c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:05.150144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db07eb-0a74-41f3-b3ae-7177655993c3 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:05.150429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db07eb-0a74-41f3-b3ae-7177655993c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:05.150707 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db07eb-0a74-41f3-b3ae-7177655993c3 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:05.151407 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db07eb-0a74-41f3-b3ae-7177655993c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:05.153304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db07eb-0a74-41f3-b3ae-7177655993c3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:05.255510 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1287/2582] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:05 2021] POST /identity/v3/users => generated 283 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:05.259637 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7d37b-bed6-4b64-8c3e-2f75d2120ef8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:05.269924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7d37b-bed6-4b64-8c3e-2f75d2120ef8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:05.274492 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf76beb-4a54-480d-adf5-dc2e4706e09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:05.275142 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf76beb-4a54-480d-adf5-dc2e4706e09d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:05.275423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf76beb-4a54-480d-adf5-dc2e4706e09d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:05.275693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf76beb-4a54-480d-adf5-dc2e4706e09d admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:05.276442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf76beb-4a54-480d-adf5-dc2e4706e09d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:05.278010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf76beb-4a54-480d-adf5-dc2e4706e09d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:05.289127 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1296/2583] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:05.296848 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db07eb-0a74-41f3-b3ae-7177655993c3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:05.306640 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db07eb-0a74-41f3-b3ae-7177655993c3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:05.311620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b82190-5fba-412b-a267-02f64a2c0b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:05.312275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82190-5fba-412b-a267-02f64a2c0b29 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:05.312551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82190-5fba-412b-a267-02f64a2c0b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:05.312821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b82190-5fba-412b-a267-02f64a2c0b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:05.313558 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b82190-5fba-412b-a267-02f64a2c0b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:05.315161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b82190-5fba-412b-a267-02f64a2c0b29 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:05.325393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1288/2584] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:05.330456 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf76beb-4a54-480d-adf5-dc2e4706e09d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:05.340425 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf76beb-4a54-480d-adf5-dc2e4706e09d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:05.345907 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66ece-9217-446a-b3ef-bac26faf8e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:05.346805 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66ece-9217-446a-b3ef-bac26faf8e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:05.347090 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66ece-9217-446a-b3ef-bac26faf8e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:05.347380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d66ece-9217-446a-b3ef-bac26faf8e65 admin admin] PATH_INFO: `/v3/projects/f02171d966cb467396bcea4e01396c3a/users/11806af1a85948b0aced84fb4d2d47c9/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:05.362095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d66ece-9217-446a-b3ef-bac26faf8e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f02171d966cb467396bcea4e01396c3a, user_id=11806af1a85948b0aced84fb4d2d47c9, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:05.364839 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d66ece-9217-446a-b3ef-bac26faf8e65 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:05.439143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1297/2585] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:05 2021] PUT /identity/v3/projects/f02171d966cb467396bcea4e01396c3a/users/11806af1a85948b0aced84fb4d2d47c9/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:05.453282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e779c-7da2-402f-90e1-9c82f972ea2b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:05.453537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e779c-7da2-402f-90e1-9c82f972ea2b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:05.453788 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e779c-7da2-402f-90e1-9c82f972ea2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:05.484703 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-6f3e779c-7da2-402f-90e1-9c82f972ea2b None None] MFA Rules not processed for user `11806af1a85948b0aced84fb4d2d47c9`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:05.485894 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-6f3e779c-7da2-402f-90e1-9c82f972ea2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:05.549076 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1289/2586] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:05 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:05.553713 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66ece-9217-446a-b3ef-bac26faf8e65 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:05.615723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d66ece-9217-446a-b3ef-bac26faf8e65 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:05.620193 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac630c-2a99-406c-9e38-60215a0b156a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:05.620834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac630c-2a99-406c-9e38-60215a0b156a admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:05.621109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac630c-2a99-406c-9e38-60215a0b156a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:05.621375 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ac630c-2a99-406c-9e38-60215a0b156a admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:05.622250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac630c-2a99-406c-9e38-60215a0b156a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:05.624651 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ac630c-2a99-406c-9e38-60215a0b156a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:05.747050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1298/2587] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:05 2021] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:05.751564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e779c-7da2-402f-90e1-9c82f972ea2b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:05.762083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3e779c-7da2-402f-90e1-9c82f972ea2b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:05.816155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3983bd-33f2-49c4-9895-0fdff241193b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:05.816837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3983bd-33f2-49c4-9895-0fdff241193b admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:05.817111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3983bd-33f2-49c4-9895-0fdff241193b admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:05.817381 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3983bd-33f2-49c4-9895-0fdff241193b admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:05.818117 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3983bd-33f2-49c4-9895-0fdff241193b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:05.820068 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3983bd-33f2-49c4-9895-0fdff241193b admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:05.950744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1290/2588] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:05 2021] POST /identity/v3/users => generated 289 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:05.954655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac630c-2a99-406c-9e38-60215a0b156a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:05.965233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ac630c-2a99-406c-9e38-60215a0b156a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:05.970684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283edfc2-142b-4847-b89d-bb6188609b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:05.971353 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283edfc2-142b-4847-b89d-bb6188609b26 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:05.971650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283edfc2-142b-4847-b89d-bb6188609b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:05.972057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283edfc2-142b-4847-b89d-bb6188609b26 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:05.972797 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283edfc2-142b-4847-b89d-bb6188609b26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:05.974621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283edfc2-142b-4847-b89d-bb6188609b26 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:05.987388 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1299/2589] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:05 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:05.990354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3983bd-33f2-49c4-9895-0fdff241193b admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:06.000498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3983bd-33f2-49c4-9895-0fdff241193b admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:06.005259 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1631c8-e1f4-4219-bf13-50c1b12990ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:06.006176 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1631c8-e1f4-4219-bf13-50c1b12990ef admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:06.006456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1631c8-e1f4-4219-bf13-50c1b12990ef admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:06.006728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1631c8-e1f4-4219-bf13-50c1b12990ef admin admin] PATH_INFO: `/v3/projects/25efca2415cd4babafe781b95eb30168/users/d8f47320a7fd422b97f387f75c0fcd51/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:06.021456 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1631c8-e1f4-4219-bf13-50c1b12990ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=25efca2415cd4babafe781b95eb30168, user_id=d8f47320a7fd422b97f387f75c0fcd51, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:06.024165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1631c8-e1f4-4219-bf13-50c1b12990ef admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:06.088000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1291/2590] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:05 2021] PUT /identity/v3/projects/25efca2415cd4babafe781b95eb30168/users/d8f47320a7fd422b97f387f75c0fcd51/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:06.092655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283edfc2-142b-4847-b89d-bb6188609b26 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:06.102725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283edfc2-142b-4847-b89d-bb6188609b26 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:06.159591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4cb4af-d933-4ec8-bb4e-766a271388a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:06.160248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cb4af-d933-4ec8-bb4e-766a271388a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:06.160524 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cb4af-d933-4ec8-bb4e-766a271388a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:06.160790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4cb4af-d933-4ec8-bb4e-766a271388a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:06.161517 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cb4af-d933-4ec8-bb4e-766a271388a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:06.163114 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4cb4af-d933-4ec8-bb4e-766a271388a1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:06.172557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1300/2591] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:06 2021] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:06.176680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1631c8-e1f4-4219-bf13-50c1b12990ef admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:06.186639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1631c8-e1f4-4219-bf13-50c1b12990ef admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:06.191189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e867d3-1efe-4bcc-bcf1-5b61d9167fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:06.192050 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e867d3-1efe-4bcc-bcf1-5b61d9167fab admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:06.192328 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e867d3-1efe-4bcc-bcf1-5b61d9167fab admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:06.192596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e867d3-1efe-4bcc-bcf1-5b61d9167fab admin admin] PATH_INFO: `/v3/projects/25efca2415cd4babafe781b95eb30168/users/d8f47320a7fd422b97f387f75c0fcd51/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:06.194555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e867d3-1efe-4bcc-bcf1-5b61d9167fab admin admin] RBAC: Authorizing `identity:create_grant(project_id=25efca2415cd4babafe781b95eb30168, user_id=d8f47320a7fd422b97f387f75c0fcd51, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:06.197389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e867d3-1efe-4bcc-bcf1-5b61d9167fab admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:06.209378 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1292/2592] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:06 2021] PUT /identity/v3/projects/25efca2415cd4babafe781b95eb30168/users/d8f47320a7fd422b97f387f75c0fcd51/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:06.220372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef074a1-5d8b-43a5-b3c5-889404bf3bca None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:06.220655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef074a1-5d8b-43a5-b3c5-889404bf3bca None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:06.220924 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef074a1-5d8b-43a5-b3c5-889404bf3bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:06.247419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-fef074a1-5d8b-43a5-b3c5-889404bf3bca None None] MFA Rules not processed for user `d8f47320a7fd422b97f387f75c0fcd51`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:06.249067 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fef074a1-5d8b-43a5-b3c5-889404bf3bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:06.316165 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1301/2593] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:06 2021] POST /identity/v3/auth/tokens => generated 3452 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:06.326648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e867d3-1efe-4bcc-bcf1-5b61d9167fab admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:06.328394 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-90e867d3-1efe-4bcc-bcf1-5b61d9167fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:06.385382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e867d3-1efe-4bcc-bcf1-5b61d9167fab admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:06.389137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7840049-e213-4312-859e-5ab8ef4eddcc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:06.389769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840049-e213-4312-859e-5ab8ef4eddcc service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:06.390083 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840049-e213-4312-859e-5ab8ef4eddcc service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:06.390360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7840049-e213-4312-859e-5ab8ef4eddcc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:06.399162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7840049-e213-4312-859e-5ab8ef4eddcc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:06.400596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7840049-e213-4312-859e-5ab8ef4eddcc service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:06.410899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1293/2594] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:06 2021] GET /identity/v3/auth/tokens => generated 3452 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:06.792007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef074a1-5d8b-43a5-b3c5-889404bf3bca None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:06.853689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef074a1-5d8b-43a5-b3c5-889404bf3bca None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:06.858876 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:06.859728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:06.860002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:06.860269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] PATH_INFO: `/v3/users/11806af1a85948b0aced84fb4d2d47c9` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:06.861431 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11806af1a85948b0aced84fb4d2d47c9)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:06.863346 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:07.057331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11806af1a85948b0aced84fb4d2d47c9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:07.063300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11806af1a85948b0aced84fb4d2d47c9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:07.070599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11806af1a85948b0aced84fb4d2d47c9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:07.133689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11806af1a85948b0aced84fb4d2d47c9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:07.134340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11806af1a85948b0aced84fb4d2d47c9'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:07.140683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1302/2595] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:06 2021] DELETE /identity/v3/users/11806af1a85948b0aced84fb4d2d47c9 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:07.145209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c228b-771a-43fb-a8b9-cb5ad5455543 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:07.145977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c228b-771a-43fb-a8b9-cb5ad5455543 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:07.145977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c228b-771a-43fb-a8b9-cb5ad5455543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:07.163650 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1c0c228b-771a-43fb-a8b9-cb5ad5455543 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:07.164843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1c0c228b-771a-43fb-a8b9-cb5ad5455543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:07.223109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1294/2596] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:07 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:07.233686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:07.235066 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:07.291450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ee92c9-59f5-48c3-aa6a-5b8a74abbdd9 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:07.295160 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735576d-5793-4024-a06d-f91af6c90858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:07.295796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735576d-5793-4024-a06d-f91af6c90858 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:07.296072 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735576d-5793-4024-a06d-f91af6c90858 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:07.296340 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735576d-5793-4024-a06d-f91af6c90858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:07.305614 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735576d-5793-4024-a06d-f91af6c90858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:07.307365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735576d-5793-4024-a06d-f91af6c90858 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:07.317124 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1303/2597] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:07 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:07.789399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c228b-771a-43fb-a8b9-cb5ad5455543 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:07.790902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1c0c228b-771a-43fb-a8b9-cb5ad5455543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:07.803836 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c228b-771a-43fb-a8b9-cb5ad5455543 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:07.809133 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:07.810936 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:07.811279 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:07.811623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] PATH_INFO: `/v3/projects/f02171d966cb467396bcea4e01396c3a` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:07.812900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f02171d966cb467396bcea4e01396c3a)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:07.814879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:07.951752 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f02171d966cb467396bcea4e01396c3a', 'request_id': 'req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:07.957712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f02171d966cb467396bcea4e01396c3a', 'request_id': 'req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:07.963282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f02171d966cb467396bcea4e01396c3a', 'request_id': 'req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:08.041685 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] The token cache is being invalidate because project f02171d966cb467396bcea4e01396c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:08.041972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:08.042632 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:08.044816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1295/2598] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:07 2021] DELETE /identity/v3/projects/f02171d966cb467396bcea4e01396c3a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:08.048950 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735576d-5793-4024-a06d-f91af6c90858 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:08.059133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735576d-5793-4024-a06d-f91af6c90858 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:08.122904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:08.123763 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:08.124040 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:08.124312 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] PATH_INFO: `/v3/users/d8f47320a7fd422b97f387f75c0fcd51` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:08.125485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8f47320a7fd422b97f387f75c0fcd51)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:08.127398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:08.302452 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8f47320a7fd422b97f387f75c0fcd51'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:08.315306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8f47320a7fd422b97f387f75c0fcd51'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:08.322051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8f47320a7fd422b97f387f75c0fcd51'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:08.455391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8f47320a7fd422b97f387f75c0fcd51'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:08.456098 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-b3150061-4477-45e4-bf96-65b5b7868eee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8f47320a7fd422b97f387f75c0fcd51'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:08.462658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1304/2599] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:08 2021] DELETE /identity/v3/users/d8f47320a7fd422b97f387f75c0fcd51 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:08.868142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:08.869575 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:08.882546 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b277bd3e-9ef5-45ae-bc40-e3ffd29928f7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:08.939923 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:08.940772 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:08.941048 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:08.941320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] PATH_INFO: `/v3/projects/25efca2415cd4babafe781b95eb30168` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:08.942534 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=25efca2415cd4babafe781b95eb30168)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:08.944404 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:09.095125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25efca2415cd4babafe781b95eb30168', 'request_id': 'req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:09.101471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25efca2415cd4babafe781b95eb30168', 'request_id': 'req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:09.107537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25efca2415cd4babafe781b95eb30168', 'request_id': 'req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:09.243343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] The token cache is being invalidate because project 25efca2415cd4babafe781b95eb30168 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:09.243626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:09.244242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc2f40c5-90d6-454e-bcd7-b762fbb11d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:09.245755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1296/2600] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:08 2021] DELETE /identity/v3/projects/25efca2415cd4babafe781b95eb30168 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:09.251489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6b419-2c61-471a-abd1-39bda7a2b1b8 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.251985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6b419-2c61-471a-abd1-39bda7a2b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.252099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6b419-2c61-471a-abd1-39bda7a2b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.269682 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-59e6b419-2c61-471a-abd1-39bda7a2b1b8 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:09.270949 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-59e6b419-2c61-471a-abd1-39bda7a2b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:09.328263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1305/2601] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:09.336024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4172a-af4a-482c-a2c4-7ed9ef4cb56b None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.336308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4172a-af4a-482c-a2c4-7ed9ef4cb56b None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.336581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c4172a-af4a-482c-a2c4-7ed9ef4cb56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.355215 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-18c4172a-af4a-482c-a2c4-7ed9ef4cb56b None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:09.356373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-18c4172a-af4a-482c-a2c4-7ed9ef4cb56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:09.364063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1297/2602] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:09 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:09.369247 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6b419-2c61-471a-abd1-39bda7a2b1b8 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:09.381194 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6b419-2c61-471a-abd1-39bda7a2b1b8 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:09.385785 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d8c93-9519-4adc-976d-7a4a8d73d9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:09.386478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8c93-9519-4adc-976d-7a4a8d73d9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.386757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8c93-9519-4adc-976d-7a4a8d73d9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.387026 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0d8c93-9519-4adc-976d-7a4a8d73d9f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.388326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d8c93-9519-4adc-976d-7a4a8d73d9f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:09.388678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d8c93-9519-4adc-976d-7a4a8d73d9f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:09.390402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0d8c93-9519-4adc-976d-7a4a8d73d9f3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:09.401668 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1306/2603] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:26:09 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:09.406555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4172a-af4a-482c-a2c4-7ed9ef4cb56b None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:09.415539 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c4172a-af4a-482c-a2c4-7ed9ef4cb56b None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:09.420308 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eb3e3-1cbf-4044-8da5-865f55612d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:09.420940 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eb3e3-1cbf-4044-8da5-865f55612d5f admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.421218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eb3e3-1cbf-4044-8da5-865f55612d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.421484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645eb3e3-1cbf-4044-8da5-865f55612d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.422214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645eb3e3-1cbf-4044-8da5-865f55612d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:09.424067 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645eb3e3-1cbf-4044-8da5-865f55612d5f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:09.553649 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1298/2604] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:09 2021] POST /identity/v3/projects => generated 377 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:09.558144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d8c93-9519-4adc-976d-7a4a8d73d9f3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:09.568711 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0d8c93-9519-4adc-976d-7a4a8d73d9f3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:09.626261 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ac83c-c5cc-46f2-9f9e-5062efde1aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:09.626917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ac83c-c5cc-46f2-9f9e-5062efde1aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.627215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ac83c-c5cc-46f2-9f9e-5062efde1aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.627465 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904ac83c-c5cc-46f2-9f9e-5062efde1aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.628147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ac83c-c5cc-46f2-9f9e-5062efde1aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:09.630143 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904ac83c-c5cc-46f2-9f9e-5062efde1aa5 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:09.746402 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1307/2605] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:09 2021] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:09.750757 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eb3e3-1cbf-4044-8da5-865f55612d5f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:09.760998 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645eb3e3-1cbf-4044-8da5-865f55612d5f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:09.765906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf370b-f397-4435-bc5e-7ee357f27385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:09.766637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf370b-f397-4435-bc5e-7ee357f27385 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.766918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf370b-f397-4435-bc5e-7ee357f27385 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.767190 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf370b-f397-4435-bc5e-7ee357f27385 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.767933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf370b-f397-4435-bc5e-7ee357f27385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:09.769496 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf370b-f397-4435-bc5e-7ee357f27385 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:09.780709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1299/2606] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:09 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:09.785579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ac83c-c5cc-46f2-9f9e-5062efde1aa5 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:09.796480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904ac83c-c5cc-46f2-9f9e-5062efde1aa5 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:09.801073 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25074a90-dc0a-4289-a9c7-2df8f78ab9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:09.801719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074a90-dc0a-4289-a9c7-2df8f78ab9ce admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.801996 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074a90-dc0a-4289-a9c7-2df8f78ab9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.802300 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25074a90-dc0a-4289-a9c7-2df8f78ab9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.803026 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25074a90-dc0a-4289-a9c7-2df8f78ab9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:09.804597 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25074a90-dc0a-4289-a9c7-2df8f78ab9ce admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:09.814569 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1308/2607] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:09 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:09.818675 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf370b-f397-4435-bc5e-7ee357f27385 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:09.828627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf370b-f397-4435-bc5e-7ee357f27385 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:09.833184 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d31e3-b905-47ac-ae70-046a281556ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:09.834088 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d31e3-b905-47ac-ae70-046a281556ec admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.834369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d31e3-b905-47ac-ae70-046a281556ec admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.834639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d31e3-b905-47ac-ae70-046a281556ec admin admin] PATH_INFO: `/v3/projects/6541772f6d244428928ee4f3601905b4/users/85bdc8e0aba142e19e45b6167114d75f/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.849283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d31e3-b905-47ac-ae70-046a281556ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=6541772f6d244428928ee4f3601905b4, user_id=85bdc8e0aba142e19e45b6167114d75f, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:09.852175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797d31e3-b905-47ac-ae70-046a281556ec admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:09.941840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1300/2608] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:09 2021] PUT /identity/v3/projects/6541772f6d244428928ee4f3601905b4/users/85bdc8e0aba142e19e45b6167114d75f/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:09.953914 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5da9a-e16e-4322-896f-3a168f0275fa None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:09.954235 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5da9a-e16e-4322-896f-3a168f0275fa None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:09.954516 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5da9a-e16e-4322-896f-3a168f0275fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:09.981273 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-b8d5da9a-e16e-4322-896f-3a168f0275fa None None] MFA Rules not processed for user `85bdc8e0aba142e19e45b6167114d75f`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:09.983367 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b8d5da9a-e16e-4322-896f-3a168f0275fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:10.052139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1309/2609] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:09 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:10.056606 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d31e3-b905-47ac-ae70-046a281556ec admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:10.117860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797d31e3-b905-47ac-ae70-046a281556ec admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:10.123201 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f45ed4-f65e-4c98-accb-6d813482eca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:10.123850 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f45ed4-f65e-4c98-accb-6d813482eca2 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.124135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f45ed4-f65e-4c98-accb-6d813482eca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.124408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f45ed4-f65e-4c98-accb-6d813482eca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.125119 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f45ed4-f65e-4c98-accb-6d813482eca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:10.127027 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f45ed4-f65e-4c98-accb-6d813482eca2 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:10.273688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1301/2610] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:10 2021] POST /identity/v3/projects => generated 379 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:26:10.277686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5da9a-e16e-4322-896f-3a168f0275fa None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:10.288650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5da9a-e16e-4322-896f-3a168f0275fa None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:10.344059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea6b8a-e637-4530-b493-731a62cf986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:10.344722 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea6b8a-e637-4530-b493-731a62cf986f admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.345001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea6b8a-e637-4530-b493-731a62cf986f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.345270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ea6b8a-e637-4530-b493-731a62cf986f admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.345986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea6b8a-e637-4530-b493-731a62cf986f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:10.347899 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ea6b8a-e637-4530-b493-731a62cf986f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:10.467604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1310/2611] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:10 2021] POST /identity/v3/users => generated 290 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:10.471641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f45ed4-f65e-4c98-accb-6d813482eca2 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:10.482972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f45ed4-f65e-4c98-accb-6d813482eca2 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:10.487709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105833-c4eb-47dd-882b-ce4fdf1dfbfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:10.488360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105833-c4eb-47dd-882b-ce4fdf1dfbfa admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.488641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105833-c4eb-47dd-882b-ce4fdf1dfbfa admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.488914 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9105833-c4eb-47dd-882b-ce4fdf1dfbfa admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.489639 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9105833-c4eb-47dd-882b-ce4fdf1dfbfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:10.491270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9105833-c4eb-47dd-882b-ce4fdf1dfbfa admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:10.501689 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1302/2612] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:10 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:10.505561 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea6b8a-e637-4530-b493-731a62cf986f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:10.515655 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ea6b8a-e637-4530-b493-731a62cf986f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:10.520513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd5f54-44ce-43f8-a26c-8d1bf6286497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:10.521162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd5f54-44ce-43f8-a26c-8d1bf6286497 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.521438 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd5f54-44ce-43f8-a26c-8d1bf6286497 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.521709 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd5f54-44ce-43f8-a26c-8d1bf6286497 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.522475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd5f54-44ce-43f8-a26c-8d1bf6286497 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:10.524102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd5f54-44ce-43f8-a26c-8d1bf6286497 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:10.534625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1311/2613] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:10 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:10.538784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105833-c4eb-47dd-882b-ce4fdf1dfbfa admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:10.549767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9105833-c4eb-47dd-882b-ce4fdf1dfbfa admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:10.554453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e2292-ed0e-4517-9657-e41038ffea42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:10.555349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2292-ed0e-4517-9657-e41038ffea42 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.555635 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2292-ed0e-4517-9657-e41038ffea42 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.555901 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2292-ed0e-4517-9657-e41038ffea42 admin admin] PATH_INFO: `/v3/projects/3b8908eb431e48a8a69cda0cb6939e91/users/73ff890e5dd9485d941796c3d5083cad/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.569537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e2292-ed0e-4517-9657-e41038ffea42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b8908eb431e48a8a69cda0cb6939e91, user_id=73ff890e5dd9485d941796c3d5083cad, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:10.572238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e2292-ed0e-4517-9657-e41038ffea42 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:10.655775 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1303/2614] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:10 2021] PUT /identity/v3/projects/3b8908eb431e48a8a69cda0cb6939e91/users/73ff890e5dd9485d941796c3d5083cad/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:26:10.666945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56596965-f14d-4718-b72d-9427a5c1fc19 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.667233 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56596965-f14d-4718-b72d-9427a5c1fc19 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.667508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56596965-f14d-4718-b72d-9427a5c1fc19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.695237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-56596965-f14d-4718-b72d-9427a5c1fc19 None None] MFA Rules not processed for user `73ff890e5dd9485d941796c3d5083cad`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:10.696441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-56596965-f14d-4718-b72d-9427a5c1fc19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:10.760301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1312/2615] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:10 2021] POST /identity/v3/auth/tokens => generated 3399 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:10.765278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e2292-ed0e-4517-9657-e41038ffea42 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:10.824745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e2292-ed0e-4517-9657-e41038ffea42 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:10.830110 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae5ac9-7c4f-4fef-8a19-ebefb99e4e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:10.830838 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae5ac9-7c4f-4fef-8a19-ebefb99e4e72 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:10.831116 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae5ac9-7c4f-4fef-8a19-ebefb99e4e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:10.831391 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae5ac9-7c4f-4fef-8a19-ebefb99e4e72 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:10.832103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae5ac9-7c4f-4fef-8a19-ebefb99e4e72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:10.833982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ae5ac9-7c4f-4fef-8a19-ebefb99e4e72 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:11.010967 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1304/2616] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:10 2021] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:11.014974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56596965-f14d-4718-b72d-9427a5c1fc19 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:11.025417 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56596965-f14d-4718-b72d-9427a5c1fc19 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:11.082642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad129d-002b-4eea-8a6b-c4360b6f3b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:11.083222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad129d-002b-4eea-8a6b-c4360b6f3b9c admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.083525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad129d-002b-4eea-8a6b-c4360b6f3b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.083792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad129d-002b-4eea-8a6b-c4360b6f3b9c admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.084483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad129d-002b-4eea-8a6b-c4360b6f3b9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:11.086408 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad129d-002b-4eea-8a6b-c4360b6f3b9c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:11.175546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1313/2617] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:11 2021] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:26:11.179467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae5ac9-7c4f-4fef-8a19-ebefb99e4e72 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:11.190014 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae5ac9-7c4f-4fef-8a19-ebefb99e4e72 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:11.194636 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260afe4-10d4-4f16-b9c5-e3425afecbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:11.195283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260afe4-10d4-4f16-b9c5-e3425afecbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.195557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260afe4-10d4-4f16-b9c5-e3425afecbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.195882 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260afe4-10d4-4f16-b9c5-e3425afecbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.196607 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260afe4-10d4-4f16-b9c5-e3425afecbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:11.198206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260afe4-10d4-4f16-b9c5-e3425afecbe3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:11.209223 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1305/2618] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:11.213368 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad129d-002b-4eea-8a6b-c4360b6f3b9c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:11.223244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad129d-002b-4eea-8a6b-c4360b6f3b9c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:11.227990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6222c-ab0a-4480-a8d3-e09a06c0d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:11.228913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6222c-ab0a-4480-a8d3-e09a06c0d992 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.229209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6222c-ab0a-4480-a8d3-e09a06c0d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.229505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b6222c-ab0a-4480-a8d3-e09a06c0d992 admin admin] PATH_INFO: `/v3/projects/f8c1de61c9f447c59f8d7664166d1c04/users/d269352a54b845b0848f56dcfa4cd12b/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.246373 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6222c-ab0a-4480-a8d3-e09a06c0d992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c1de61c9f447c59f8d7664166d1c04, user_id=d269352a54b845b0848f56dcfa4cd12b, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:11.249653 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b6222c-ab0a-4480-a8d3-e09a06c0d992 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:11.352626 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1314/2619] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:11 2021] PUT /identity/v3/projects/f8c1de61c9f447c59f8d7664166d1c04/users/d269352a54b845b0848f56dcfa4cd12b/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:11.356849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260afe4-10d4-4f16-b9c5-e3425afecbe3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:11.366577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260afe4-10d4-4f16-b9c5-e3425afecbe3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:11.423132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb0a3e-0b84-4e1e-acdc-97bf4980f61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:11.423829 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb0a3e-0b84-4e1e-acdc-97bf4980f61d admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.424111 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb0a3e-0b84-4e1e-acdc-97bf4980f61d admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.424383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb0a3e-0b84-4e1e-acdc-97bf4980f61d admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.425220 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb0a3e-0b84-4e1e-acdc-97bf4980f61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:11.426830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bb0a3e-0b84-4e1e-acdc-97bf4980f61d admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:11.436997 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1306/2620] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:11 2021] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:11.441203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6222c-ab0a-4480-a8d3-e09a06c0d992 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:11.452451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b6222c-ab0a-4480-a8d3-e09a06c0d992 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:11.457052 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcf68e-d8db-458a-b111-ff45e38a31ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:11.457921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcf68e-d8db-458a-b111-ff45e38a31ce admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.458237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcf68e-d8db-458a-b111-ff45e38a31ce admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.458526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bcf68e-d8db-458a-b111-ff45e38a31ce admin admin] PATH_INFO: `/v3/projects/f8c1de61c9f447c59f8d7664166d1c04/users/d269352a54b845b0848f56dcfa4cd12b/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.460654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcf68e-d8db-458a-b111-ff45e38a31ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8c1de61c9f447c59f8d7664166d1c04, user_id=d269352a54b845b0848f56dcfa4cd12b, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:11.463601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bcf68e-d8db-458a-b111-ff45e38a31ce admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:11.476461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1315/2621] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:11 2021] PUT /identity/v3/projects/f8c1de61c9f447c59f8d7664166d1c04/users/d269352a54b845b0848f56dcfa4cd12b/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:11.487393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b3d3-e628-4ccd-ba62-e39094d299ee None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.487681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b3d3-e628-4ccd-ba62-e39094d299ee None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.487957 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350b3d3-e628-4ccd-ba62-e39094d299ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.514851 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d350b3d3-e628-4ccd-ba62-e39094d299ee None None] MFA Rules not processed for user `d269352a54b845b0848f56dcfa4cd12b`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:11.516034 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d350b3d3-e628-4ccd-ba62-e39094d299ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:11.581774 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1307/2622] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:11 2021] POST /identity/v3/auth/tokens => generated 3464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:11.595535 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcf68e-d8db-458a-b111-ff45e38a31ce admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:11.597298 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-01bcf68e-d8db-458a-b111-ff45e38a31ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:11.656999 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bcf68e-d8db-458a-b111-ff45e38a31ce admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:11.660571 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcffe17-3b20-4791-ad9c-d5c1289d6088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:11.661206 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcffe17-3b20-4791-ad9c-d5c1289d6088 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.661480 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcffe17-3b20-4791-ad9c-d5c1289d6088 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.661750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcffe17-3b20-4791-ad9c-d5c1289d6088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.670779 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcffe17-3b20-4791-ad9c-d5c1289d6088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:11.672223 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcffe17-3b20-4791-ad9c-d5c1289d6088 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:11.681205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1316/2623] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:11 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:26:11.809713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b3d3-e628-4ccd-ba62-e39094d299ee None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:11.811108 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d350b3d3-e628-4ccd-ba62-e39094d299ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:11.822870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350b3d3-e628-4ccd-ba62-e39094d299ee None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:11.826708 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a5033b-df91-4a6e-80d9-28dd043c66c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:11.827333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5033b-df91-4a6e-80d9-28dd043c66c1 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:11.827610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5033b-df91-4a6e-80d9-28dd043c66c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:11.830990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a5033b-df91-4a6e-80d9-28dd043c66c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:11.881736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5033b-df91-4a6e-80d9-28dd043c66c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:11.883244 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a5033b-df91-4a6e-80d9-28dd043c66c1 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:11.893200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1308/2624] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:11 2021] GET /identity/v3/auth/tokens => generated 3397 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:16.090119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcffe17-3b20-4791-ad9c-d5c1289d6088 service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:16.158140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcffe17-3b20-4791-ad9c-d5c1289d6088 service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:16.162975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:16.164538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:16.164804 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:16.165072 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] PATH_INFO: `/v3/users/85bdc8e0aba142e19e45b6167114d75f` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:16.175257 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85bdc8e0aba142e19e45b6167114d75f)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:16.177309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:16.411116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85bdc8e0aba142e19e45b6167114d75f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:16.425121 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85bdc8e0aba142e19e45b6167114d75f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:16.437156 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85bdc8e0aba142e19e45b6167114d75f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:16.551765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85bdc8e0aba142e19e45b6167114d75f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:16.552430 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85bdc8e0aba142e19e45b6167114d75f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:16.561157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1317/2625] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:16 2021] DELETE /identity/v3/users/85bdc8e0aba142e19e45b6167114d75f => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:16.565917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ee4a1-4a8a-4999-8ebe-8e5ae95681fb None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:16.566461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ee4a1-4a8a-4999-8ebe-8e5ae95681fb None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:16.566796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ee4a1-4a8a-4999-8ebe-8e5ae95681fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:16.584835 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-3c4ee4a1-4a8a-4999-8ebe-8e5ae95681fb None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:16.586431 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-3c4ee4a1-4a8a-4999-8ebe-8e5ae95681fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:16.649337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1309/2626] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:16 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:16.660085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:16.661476 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:16.719635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b518c4d-dc55-48d2-9763-6a9c5cf19cd4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:16.722952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8336f3-922f-4270-8b4b-e5024bd3e9a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:16.726049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8336f3-922f-4270-8b4b-e5024bd3e9a0 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:16.726049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8336f3-922f-4270-8b4b-e5024bd3e9a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:16.726049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8336f3-922f-4270-8b4b-e5024bd3e9a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:16.734338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8336f3-922f-4270-8b4b-e5024bd3e9a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:16.735774 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8336f3-922f-4270-8b4b-e5024bd3e9a0 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:16.745687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1318/2627] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:16 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:17.268331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ee4a1-4a8a-4999-8ebe-8e5ae95681fb None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:17.272225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-3c4ee4a1-4a8a-4999-8ebe-8e5ae95681fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:17.282363 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ee4a1-4a8a-4999-8ebe-8e5ae95681fb None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:17.287192 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:17.288174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:17.288461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:17.288730 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] PATH_INFO: `/v3/projects/6541772f6d244428928ee4f3601905b4` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:17.289953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6541772f6d244428928ee4f3601905b4)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:17.291869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:17.454766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6541772f6d244428928ee4f3601905b4', 'request_id': 'req-a17317ce-be83-4ca1-80a2-be5a02aa13fd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:17.462454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6541772f6d244428928ee4f3601905b4', 'request_id': 'req-a17317ce-be83-4ca1-80a2-be5a02aa13fd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:17.470574 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6541772f6d244428928ee4f3601905b4', 'request_id': 'req-a17317ce-be83-4ca1-80a2-be5a02aa13fd'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:17.609556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] The token cache is being invalidate because project 6541772f6d244428928ee4f3601905b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:17.610242 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:17.610473 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:17.612005 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1310/2628] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:17 2021] DELETE /identity/v3/projects/6541772f6d244428928ee4f3601905b4 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:17.615935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8336f3-922f-4270-8b4b-e5024bd3e9a0 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:17.626484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8336f3-922f-4270-8b4b-e5024bd3e9a0 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:17.680773 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:17.681551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:17.681827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:17.682128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] PATH_INFO: `/v3/users/73ff890e5dd9485d941796c3d5083cad` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:17.683306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73ff890e5dd9485d941796c3d5083cad)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:17.686321 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:17.876026 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73ff890e5dd9485d941796c3d5083cad'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:17.889767 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73ff890e5dd9485d941796c3d5083cad'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:17.896990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73ff890e5dd9485d941796c3d5083cad'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:17.998140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73ff890e5dd9485d941796c3d5083cad'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:17.998733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73ff890e5dd9485d941796c3d5083cad'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:18.005037 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1319/2629] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:17 2021] DELETE /identity/v3/users/73ff890e5dd9485d941796c3d5083cad => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:18.405301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:18.406757 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:18.422167 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17317ce-be83-4ca1-80a2-be5a02aa13fd admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:18.477216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:18.478091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:18.478370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:18.478641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] PATH_INFO: `/v3/projects/3b8908eb431e48a8a69cda0cb6939e91` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:18.479830 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b8908eb431e48a8a69cda0cb6939e91)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:18.482346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:18.596766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b8908eb431e48a8a69cda0cb6939e91', 'request_id': 'req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:18.603029 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b8908eb431e48a8a69cda0cb6939e91', 'request_id': 'req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:18.608889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b8908eb431e48a8a69cda0cb6939e91', 'request_id': 'req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:18.694226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] The token cache is being invalidate because project 3b8908eb431e48a8a69cda0cb6939e91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:18.694884 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:18.695233 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:18.696821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1311/2630] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:18 2021] DELETE /identity/v3/projects/3b8908eb431e48a8a69cda0cb6939e91 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:18.701505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:18.702909 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:18.715391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a159295-9a16-45f2-a87d-308f6d7e56e3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:18.771656 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:18.772513 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:18.772787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:18.773049 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] PATH_INFO: `/v3/users/d269352a54b845b0848f56dcfa4cd12b` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:18.774283 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d269352a54b845b0848f56dcfa4cd12b)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:18.776182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:18.963549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd269352a54b845b0848f56dcfa4cd12b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:18.975355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd269352a54b845b0848f56dcfa4cd12b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:18.982723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd269352a54b845b0848f56dcfa4cd12b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:19.094838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd269352a54b845b0848f56dcfa4cd12b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:19.095454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-348e3b3d-239e-438e-a310-7cd4efcbb00f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd269352a54b845b0848f56dcfa4cd12b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:19.102152 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1320/2631] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:18 2021] DELETE /identity/v3/users/d269352a54b845b0848f56dcfa4cd12b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:26:19.804811 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:19.806302 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:19.828970 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e63fdf-fa1c-42ae-a56c-95f5ee4ff124 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:19.888012 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:19.888784 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:19.889062 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:19.889331 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] PATH_INFO: `/v3/projects/f8c1de61c9f447c59f8d7664166d1c04` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:19.890647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8c1de61c9f447c59f8d7664166d1c04)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:19.892519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:20.024408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8c1de61c9f447c59f8d7664166d1c04', 'request_id': 'req-00d08058-1e99-412c-aef4-e53f6e8a69bc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:20.032696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8c1de61c9f447c59f8d7664166d1c04', 'request_id': 'req-00d08058-1e99-412c-aef4-e53f6e8a69bc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:20.039357 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8c1de61c9f447c59f8d7664166d1c04', 'request_id': 'req-00d08058-1e99-412c-aef4-e53f6e8a69bc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:20.116156 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] The token cache is being invalidate because project f8c1de61c9f447c59f8d7664166d1c04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:20.116439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:20.117072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-00d08058-1e99-412c-aef4-e53f6e8a69bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:20.118729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1312/2632] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:19 2021] DELETE /identity/v3/projects/f8c1de61c9f447c59f8d7664166d1c04 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:20.126149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4919ba-1e3f-4c38-ac12-7a9a54cdce5c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.126654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4919ba-1e3f-4c38-ac12-7a9a54cdce5c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.126750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4919ba-1e3f-4c38-ac12-7a9a54cdce5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.144723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-0d4919ba-1e3f-4c38-ac12-7a9a54cdce5c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:20.145945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0d4919ba-1e3f-4c38-ac12-7a9a54cdce5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:20.201562 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1321/2633] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:20.210905 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62620d-efbb-4168-accb-16d728d7c4f0 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.211187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62620d-efbb-4168-accb-16d728d7c4f0 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.211460 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a62620d-efbb-4168-accb-16d728d7c4f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.229783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-3a62620d-efbb-4168-accb-16d728d7c4f0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:20.231045 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-3a62620d-efbb-4168-accb-16d728d7c4f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:20.239253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1313/2634] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:20 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:20.243532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4919ba-1e3f-4c38-ac12-7a9a54cdce5c None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:20.253630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4919ba-1e3f-4c38-ac12-7a9a54cdce5c None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:20.258140 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4721bb9-3574-4f27-a0a4-6c8a571ddc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:20.258813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4721bb9-3574-4f27-a0a4-6c8a571ddc3d admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.259149 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4721bb9-3574-4f27-a0a4-6c8a571ddc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.259364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4721bb9-3574-4f27-a0a4-6c8a571ddc3d admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.260144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4721bb9-3574-4f27-a0a4-6c8a571ddc3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:20.260440 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4721bb9-3574-4f27-a0a4-6c8a571ddc3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:20.262047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4721bb9-3574-4f27-a0a4-6c8a571ddc3d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:20.274446 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1322/2635] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:26:20 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:20.278984 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62620d-efbb-4168-accb-16d728d7c4f0 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:20.287929 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a62620d-efbb-4168-accb-16d728d7c4f0 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:20.292494 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568ae4e-e334-405e-a0a8-3d226cd5357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:20.293126 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ae4e-e334-405e-a0a8-3d226cd5357f admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.293419 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ae4e-e334-405e-a0a8-3d226cd5357f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.296390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d568ae4e-e334-405e-a0a8-3d226cd5357f admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.296390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568ae4e-e334-405e-a0a8-3d226cd5357f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:20.296390 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d568ae4e-e334-405e-a0a8-3d226cd5357f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:20.443436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1314/2636] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:20 2021] POST /identity/v3/projects => generated 385 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:20.447564 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4721bb9-3574-4f27-a0a4-6c8a571ddc3d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:20.457339 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4721bb9-3574-4f27-a0a4-6c8a571ddc3d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:20.512183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010272e-7225-46ff-b920-2c7a84215d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:20.512944 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010272e-7225-46ff-b920-2c7a84215d6a admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.513222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010272e-7225-46ff-b920-2c7a84215d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.513494 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4010272e-7225-46ff-b920-2c7a84215d6a admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.514258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010272e-7225-46ff-b920-2c7a84215d6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:20.516178 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4010272e-7225-46ff-b920-2c7a84215d6a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:20.658328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1323/2637] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:20 2021] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:20.659388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568ae4e-e334-405e-a0a8-3d226cd5357f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:20.670222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d568ae4e-e334-405e-a0a8-3d226cd5357f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:20.674933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70fad0-291d-4b3d-8504-7fd465369541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:20.675692 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70fad0-291d-4b3d-8504-7fd465369541 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.675982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70fad0-291d-4b3d-8504-7fd465369541 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.679840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70fad0-291d-4b3d-8504-7fd465369541 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.679840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70fad0-291d-4b3d-8504-7fd465369541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:20.679840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70fad0-291d-4b3d-8504-7fd465369541 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:20.690728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1315/2638] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:20.695096 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010272e-7225-46ff-b920-2c7a84215d6a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:20.705629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4010272e-7225-46ff-b920-2c7a84215d6a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:20.710370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98205d66-86fb-4740-99ec-0f30e0c673e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:20.713608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205d66-86fb-4740-99ec-0f30e0c673e2 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.713608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205d66-86fb-4740-99ec-0f30e0c673e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.713608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98205d66-86fb-4740-99ec-0f30e0c673e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.713608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205d66-86fb-4740-99ec-0f30e0c673e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:20.714046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98205d66-86fb-4740-99ec-0f30e0c673e2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:20.725116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1324/2639] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:20 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:20.729041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70fad0-291d-4b3d-8504-7fd465369541 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:20.742096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70fad0-291d-4b3d-8504-7fd465369541 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:20.747389 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70daa361-e1be-43d8-aeb3-31e527e339c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:20.748282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa361-e1be-43d8-aeb3-31e527e339c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.748634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa361-e1be-43d8-aeb3-31e527e339c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.748953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70daa361-e1be-43d8-aeb3-31e527e339c1 admin admin] PATH_INFO: `/v3/projects/6305641f997d4e7eab14932a42f0386a/users/4bb035acae63401381bbb3dad679285a/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.752621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97559e18-55ba-4305-967a-60327aaa0f7a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.752917 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97559e18-55ba-4305-967a-60327aaa0f7a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.753174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97559e18-55ba-4305-967a-60327aaa0f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.770507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa361-e1be-43d8-aeb3-31e527e339c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6305641f997d4e7eab14932a42f0386a, user_id=4bb035acae63401381bbb3dad679285a, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:20.772087 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-97559e18-55ba-4305-967a-60327aaa0f7a None None] MFA Rules not processed for user `eb7fe651d1c84f28a9267a543d0e2497`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:20.773287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-97559e18-55ba-4305-967a-60327aaa0f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:20.774187 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70daa361-e1be-43d8-aeb3-31e527e339c1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:20.829411 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1325/2640] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:20 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:20.830301 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97559e18-55ba-4305-967a-60327aaa0f7a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:20.831625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-97559e18-55ba-4305-967a-60327aaa0f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:20.888681 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97559e18-55ba-4305-967a-60327aaa0f7a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:20.897130 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1316/2641] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:20 2021] PUT /identity/v3/projects/6305641f997d4e7eab14932a42f0386a/users/4bb035acae63401381bbb3dad679285a/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:26:20.908320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632c559-5905-43f6-ac97-f5c095a23dfc None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.908608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632c559-5905-43f6-ac97-f5c095a23dfc None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.909313 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e632c559-5905-43f6-ac97-f5c095a23dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.937609 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e632c559-5905-43f6-ac97-f5c095a23dfc None None] MFA Rules not processed for user `4bb035acae63401381bbb3dad679285a`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:20.939442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e632c559-5905-43f6-ac97-f5c095a23dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:20.941698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5ad3-5c95-45a9-95c2-150604231240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:20.942382 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5ad3-5c95-45a9-95c2-150604231240 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:20.942664 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5ad3-5c95-45a9-95c2-150604231240 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:20.942945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b5ad3-5c95-45a9-95c2-150604231240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:20.944691 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e25b5ad3-5c95-45a9-95c2-150604231240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:21.009298 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b5ad3-5c95-45a9-95c2-150604231240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:21.010962 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b5ad3-5c95-45a9-95c2-150604231240 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:21.021616 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1326/2642] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:20 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:21.029865 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1317/2643] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:20 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:21.034391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5ad3-5c95-45a9-95c2-150604231240 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:21.044081 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b5ad3-5c95-45a9-95c2-150604231240 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:21.049088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97e87d-687f-4bab-acf4-36b93361c2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:21.049742 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97e87d-687f-4bab-acf4-36b93361c2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.050044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97e87d-687f-4bab-acf4-36b93361c2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.050698 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd97e87d-687f-4bab-acf4-36b93361c2d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:21.051020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97e87d-687f-4bab-acf4-36b93361c2d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:21.052943 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd97e87d-687f-4bab-acf4-36b93361c2d4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:21.151716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632c559-5905-43f6-ac97-f5c095a23dfc None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:21.154806 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1327/2644] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:21 2021] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:21.165282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e632c559-5905-43f6-ac97-f5c095a23dfc None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:21.201631 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97e87d-687f-4bab-acf4-36b93361c2d4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:21.203854 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fd97e87d-687f-4bab-acf4-36b93361c2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:21.263783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f147e3-35a9-4572-bf83-f7265ab7ea89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:21.263783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f147e3-35a9-4572-bf83-f7265ab7ea89 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.263783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f147e3-35a9-4572-bf83-f7265ab7ea89 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.263783 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f147e3-35a9-4572-bf83-f7265ab7ea89 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:21.264293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f147e3-35a9-4572-bf83-f7265ab7ea89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:21.264293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f147e3-35a9-4572-bf83-f7265ab7ea89 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:21.283364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd97e87d-687f-4bab-acf4-36b93361c2d4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:21.287085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce840d-28c2-4a59-9aa0-94011f66bc54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:21.287713 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce840d-28c2-4a59-9aa0-94011f66bc54 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.287992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce840d-28c2-4a59-9aa0-94011f66bc54 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.288270 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce840d-28c2-4a59-9aa0-94011f66bc54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:21.290147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-09ce840d-28c2-4a59-9aa0-94011f66bc54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:21.300423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce840d-28c2-4a59-9aa0-94011f66bc54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:21.301845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce840d-28c2-4a59-9aa0-94011f66bc54 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:21.311281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1328/2645] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:21 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:21.370935 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1318/2646] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:21 2021] POST /identity/v3/users => generated 299 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:21.375234 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce840d-28c2-4a59-9aa0-94011f66bc54 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:21.386845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce840d-28c2-4a59-9aa0-94011f66bc54 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:21.392306 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1426-129c-4fcc-a0ce-fe7d8cb8c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:21.393867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1426-129c-4fcc-a0ce-fe7d8cb8c1aa admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.393867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1426-129c-4fcc-a0ce-fe7d8cb8c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.394156 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdea1426-129c-4fcc-a0ce-fe7d8cb8c1aa admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:21.394713 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1426-129c-4fcc-a0ce-fe7d8cb8c1aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:21.396529 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdea1426-129c-4fcc-a0ce-fe7d8cb8c1aa admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:21.409536 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1329/2647] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:26:21.413671 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f147e3-35a9-4572-bf83-f7265ab7ea89 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:21.424346 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f147e3-35a9-4572-bf83-f7265ab7ea89 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:21.429349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d1208-01d0-4370-89f5-38331f795935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:21.430620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d1208-01d0-4370-89f5-38331f795935 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.430904 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d1208-01d0-4370-89f5-38331f795935 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.431293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6d1208-01d0-4370-89f5-38331f795935 admin admin] PATH_INFO: `/v3/projects/c8ed7ba5a8024f1c99b15bd363c5c780/users/9a232477595c4a3a9b8f8372814b2b43/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:21.449086 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d1208-01d0-4370-89f5-38331f795935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ed7ba5a8024f1c99b15bd363c5c780, user_id=9a232477595c4a3a9b8f8372814b2b43, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:21.452081 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6d1208-01d0-4370-89f5-38331f795935 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:21.528978 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1319/2648] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:21 2021] PUT /identity/v3/projects/c8ed7ba5a8024f1c99b15bd363c5c780/users/9a232477595c4a3a9b8f8372814b2b43/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:21.533672 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1426-129c-4fcc-a0ce-fe7d8cb8c1aa admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:21.544542 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdea1426-129c-4fcc-a0ce-fe7d8cb8c1aa admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:21.623981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f75eb-270d-45b0-9d28-6e96f86e410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:21.625138 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f75eb-270d-45b0-9d28-6e96f86e410f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.625490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f75eb-270d-45b0-9d28-6e96f86e410f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.625842 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f75eb-270d-45b0-9d28-6e96f86e410f admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:21.626694 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f75eb-270d-45b0-9d28-6e96f86e410f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:21.628711 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f75eb-270d-45b0-9d28-6e96f86e410f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:21.640706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1330/2649] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:21 2021] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:21.645492 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d1208-01d0-4370-89f5-38331f795935 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:21.658291 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6d1208-01d0-4370-89f5-38331f795935 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:21.663204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e299a-37f1-4d44-8a4c-eb216c1a789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:21.664098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e299a-37f1-4d44-8a4c-eb216c1a789c admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.664375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e299a-37f1-4d44-8a4c-eb216c1a789c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.664646 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e299a-37f1-4d44-8a4c-eb216c1a789c admin admin] PATH_INFO: `/v3/projects/c8ed7ba5a8024f1c99b15bd363c5c780/users/9a232477595c4a3a9b8f8372814b2b43/roles/ace9f50cac674ba897bcc0c7a470e7bb` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:21.666697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e299a-37f1-4d44-8a4c-eb216c1a789c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ed7ba5a8024f1c99b15bd363c5c780, user_id=9a232477595c4a3a9b8f8372814b2b43, role_id=ace9f50cac674ba897bcc0c7a470e7bb)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:21.670020 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e299a-37f1-4d44-8a4c-eb216c1a789c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:21.680317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1320/2650] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:21 2021] PUT /identity/v3/projects/c8ed7ba5a8024f1c99b15bd363c5c780/users/9a232477595c4a3a9b8f8372814b2b43/roles/ace9f50cac674ba897bcc0c7a470e7bb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:26:21.690989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bddb1-a8e3-48f9-b3a7-3ed114e62b1f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.691359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bddb1-a8e3-48f9-b3a7-3ed114e62b1f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.691642 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2bddb1-a8e3-48f9-b3a7-3ed114e62b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:21.718883 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-8b2bddb1-a8e3-48f9-b3a7-3ed114e62b1f None None] MFA Rules not processed for user `9a232477595c4a3a9b8f8372814b2b43`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:21.720091 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8b2bddb1-a8e3-48f9-b3a7-3ed114e62b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:21.798003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1331/2651] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:21 2021] POST /identity/v3/auth/tokens => generated 3472 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:21.804795 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e299a-37f1-4d44-8a4c-eb216c1a789c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:21.806492 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c28e299a-37f1-4d44-8a4c-eb216c1a789c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:21.866070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e299a-37f1-4d44-8a4c-eb216c1a789c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:21.869751 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42400e-8cd3-4759-b30b-3e1966e487f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:21.870468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42400e-8cd3-4759-b30b-3e1966e487f7 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:21.870746 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42400e-8cd3-4759-b30b-3e1966e487f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:21.871018 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd42400e-8cd3-4759-b30b-3e1966e487f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:21.927696 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42400e-8cd3-4759-b30b-3e1966e487f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:21.929146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd42400e-8cd3-4759-b30b-3e1966e487f7 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:21.939103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1321/2652] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:21 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:26:25.345712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bddb1-a8e3-48f9-b3a7-3ed114e62b1f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:25.347292 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8b2bddb1-a8e3-48f9-b3a7-3ed114e62b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:25.413010 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2bddb1-a8e3-48f9-b3a7-3ed114e62b1f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:25.417712 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:25.418979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:25.419276 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:25.419505 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] PATH_INFO: `/v3/users/ff1374f1e319492da48f32b53c91f3ac` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:25.420737 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff1374f1e319492da48f32b53c91f3ac)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:25.422725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:25.710266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff1374f1e319492da48f32b53c91f3ac'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:25.727365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff1374f1e319492da48f32b53c91f3ac'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:25.736048 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff1374f1e319492da48f32b53c91f3ac'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:25.808968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff1374f1e319492da48f32b53c91f3ac'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:25.809667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-a39fc07f-1f24-46be-a5c4-1397bd6501ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff1374f1e319492da48f32b53c91f3ac'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:25.817071 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1332/2653] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:25 2021] DELETE /identity/v3/users/ff1374f1e319492da48f32b53c91f3ac => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:26.176652 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42400e-8cd3-4759-b30b-3e1966e487f7 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:26.189453 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd42400e-8cd3-4759-b30b-3e1966e487f7 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:26.298656 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:26.299619 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:26.299891 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:26.300160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] PATH_INFO: `/v3/projects/6304b3ad2b4e4bf398ccbae70b72f46d` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:26.301411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6304b3ad2b4e4bf398ccbae70b72f46d)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:26.304141 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:26.431815 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6304b3ad2b4e4bf398ccbae70b72f46d', 'request_id': 'req-428737cc-7630-46e9-9f1f-38500d7fe4eb'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:26.438555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6304b3ad2b4e4bf398ccbae70b72f46d', 'request_id': 'req-428737cc-7630-46e9-9f1f-38500d7fe4eb'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:26.443812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6304b3ad2b4e4bf398ccbae70b72f46d', 'request_id': 'req-428737cc-7630-46e9-9f1f-38500d7fe4eb'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:26.636414 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] The token cache is being invalidate because project 6304b3ad2b4e4bf398ccbae70b72f46d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:26.638567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:26.638567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-428737cc-7630-46e9-9f1f-38500d7fe4eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:26.640797 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1322/2654] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:26 2021] DELETE /identity/v3/projects/6304b3ad2b4e4bf398ccbae70b72f46d => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:26.646484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32941b11-e52b-4f4d-85d6-d14c8d53f76e None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:26.647043 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32941b11-e52b-4f4d-85d6-d14c8d53f76e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:26.647621 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32941b11-e52b-4f4d-85d6-d14c8d53f76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:26.667415 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-32941b11-e52b-4f4d-85d6-d14c8d53f76e None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:26.671224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-32941b11-e52b-4f4d-85d6-d14c8d53f76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:26.742063 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1333/2655] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:26.750719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a56186-d2ba-4dcf-964c-86866fe06789 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:26.751204 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a56186-d2ba-4dcf-964c-86866fe06789 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:26.751547 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a56186-d2ba-4dcf-964c-86866fe06789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:26.785626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-01a56186-d2ba-4dcf-964c-86866fe06789 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:26.786890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-01a56186-d2ba-4dcf-964c-86866fe06789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:26.796446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1323/2656] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:26 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:26.800765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32941b11-e52b-4f4d-85d6-d14c8d53f76e None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:26.814630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32941b11-e52b-4f4d-85d6-d14c8d53f76e None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:26.819868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1085a4-2110-4bcb-a4a3-77215644904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:26.820762 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1085a4-2110-4bcb-a4a3-77215644904c admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:26.821056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1085a4-2110-4bcb-a4a3-77215644904c admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:26.821372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1085a4-2110-4bcb-a4a3-77215644904c admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:26.822502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1085a4-2110-4bcb-a4a3-77215644904c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:26.822986 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1085a4-2110-4bcb-a4a3-77215644904c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:26.826525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1085a4-2110-4bcb-a4a3-77215644904c admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:26.839169 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1334/2657] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:26:26 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:26:26.844253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a56186-d2ba-4dcf-964c-86866fe06789 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:26.853857 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a56186-d2ba-4dcf-964c-86866fe06789 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:26.859155 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143e632-ed18-4ff7-8f52-ea2bd0cf35f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:26.860581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143e632-ed18-4ff7-8f52-ea2bd0cf35f6 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:26.860581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143e632-ed18-4ff7-8f52-ea2bd0cf35f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:26.860581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7143e632-ed18-4ff7-8f52-ea2bd0cf35f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:26.861102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143e632-ed18-4ff7-8f52-ea2bd0cf35f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:26.863024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7143e632-ed18-4ff7-8f52-ea2bd0cf35f6 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:26.977739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1324/2658] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:26 2021] POST /identity/v3/projects => generated 365 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:26:26.979185 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1085a4-2110-4bcb-a4a3-77215644904c admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:26.996577 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1085a4-2110-4bcb-a4a3-77215644904c admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:27.061162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908752-828d-4d93-a834-e46386c458b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:27.061923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908752-828d-4d93-a834-e46386c458b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:27.062237 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908752-828d-4d93-a834-e46386c458b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:27.062515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84908752-828d-4d93-a834-e46386c458b4 admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:27.063581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908752-828d-4d93-a834-e46386c458b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:27.065329 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84908752-828d-4d93-a834-e46386c458b4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:27.396572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143e632-ed18-4ff7-8f52-ea2bd0cf35f6 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:27.398272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-7143e632-ed18-4ff7-8f52-ea2bd0cf35f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:27.435370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1335/2659] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:26 2021] POST /identity/v3/users => generated 283 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:26:27.436633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908752-828d-4d93-a834-e46386c458b4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:27.448778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84908752-828d-4d93-a834-e46386c458b4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:27.454153 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77967d92-257e-47d1-8d28-2504cb415f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:27.454816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77967d92-257e-47d1-8d28-2504cb415f5f admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:27.455144 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77967d92-257e-47d1-8d28-2504cb415f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:27.455420 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77967d92-257e-47d1-8d28-2504cb415f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:27.456147 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77967d92-257e-47d1-8d28-2504cb415f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:27.457833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77967d92-257e-47d1-8d28-2504cb415f5f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:27.460878 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7143e632-ed18-4ff7-8f52-ea2bd0cf35f6 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:27.464843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b2cc01-5c25-445a-8ba0-201e7b07d1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:27.465600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2cc01-5c25-445a-8ba0-201e7b07d1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:27.465974 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2cc01-5c25-445a-8ba0-201e7b07d1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:27.466441 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b2cc01-5c25-445a-8ba0-201e7b07d1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:27.468324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a8b2cc01-5c25-445a-8ba0-201e7b07d1d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:27.471439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1336/2660] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:27 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:26:27.472362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77967d92-257e-47d1-8d28-2504cb415f5f admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:27.482772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77967d92-257e-47d1-8d28-2504cb415f5f admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:27.487462 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617b579-f7b0-4149-a36b-10d1d25cce99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:27.493506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617b579-f7b0-4149-a36b-10d1d25cce99 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:27.493506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617b579-f7b0-4149-a36b-10d1d25cce99 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:27.493506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4617b579-f7b0-4149-a36b-10d1d25cce99 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:27.493506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617b579-f7b0-4149-a36b-10d1d25cce99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:27.493506 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4617b579-f7b0-4149-a36b-10d1d25cce99 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:27.506401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1337/2661] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:27 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:27.510200 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617b579-f7b0-4149-a36b-10d1d25cce99 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:27.521547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4617b579-f7b0-4149-a36b-10d1d25cce99 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:27.527158 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54efde7-e8af-4430-a884-18564c0b7f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:27.528836 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54efde7-e8af-4430-a884-18564c0b7f90 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:27.529370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54efde7-e8af-4430-a884-18564c0b7f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:27.529818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54efde7-e8af-4430-a884-18564c0b7f90 admin admin] PATH_INFO: `/v3/projects/a98ca56cd18a44858f24a67eb6864248/users/53c249a9d203460c983f174ae259e002/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:27.541769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2cc01-5c25-445a-8ba0-201e7b07d1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:27.544128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b2cc01-5c25-445a-8ba0-201e7b07d1d1 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:27.545260 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54efde7-e8af-4430-a884-18564c0b7f90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a98ca56cd18a44858f24a67eb6864248, user_id=53c249a9d203460c983f174ae259e002, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:27.548000 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54efde7-e8af-4430-a884-18564c0b7f90 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:27.554918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1325/2662] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:27 2021] GET /identity/v3/auth/tokens => generated 3472 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:26:27.700627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1338/2663] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:27 2021] PUT /identity/v3/projects/a98ca56cd18a44858f24a67eb6864248/users/53c249a9d203460c983f174ae259e002/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:27.711870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7088108-ef72-4940-8591-618697a59cde None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:27.712268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7088108-ef72-4940-8591-618697a59cde None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:27.712625 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7088108-ef72-4940-8591-618697a59cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:27.741503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-f7088108-ef72-4940-8591-618697a59cde None None] MFA Rules not processed for user `53c249a9d203460c983f174ae259e002`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:27.742962 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f7088108-ef72-4940-8591-618697a59cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:27.810886 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1326/2664] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:27 2021] POST /identity/v3/auth/tokens => generated 3385 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:27.824051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54efde7-e8af-4430-a884-18564c0b7f90 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:27.824051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a54efde7-e8af-4430-a884-18564c0b7f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:27.878141 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54efde7-e8af-4430-a884-18564c0b7f90 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:27.881720 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6bb205-329d-49bd-9f92-641258ea5c3a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:27.882391 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bb205-329d-49bd-9f92-641258ea5c3a service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:27.882667 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bb205-329d-49bd-9f92-641258ea5c3a service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:27.882932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6bb205-329d-49bd-9f92-641258ea5c3a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:27.896689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bb205-329d-49bd-9f92-641258ea5c3a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:27.896689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6bb205-329d-49bd-9f92-641258ea5c3a service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:27.902796 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1339/2665] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:27 2021] GET /identity/v3/auth/tokens => generated 3385 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:33.690250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7088108-ef72-4940-8591-618697a59cde None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:33.691641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f7088108-ef72-4940-8591-618697a59cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:33.765627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7088108-ef72-4940-8591-618697a59cde None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:33.771983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:33.772872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:33.773531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:33.773531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] PATH_INFO: `/v3/users/4bb035acae63401381bbb3dad679285a` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:33.776100 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bb035acae63401381bbb3dad679285a)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:33.778360 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:34.017146 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bb035acae63401381bbb3dad679285a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:34.029713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bb035acae63401381bbb3dad679285a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:34.036324 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bb035acae63401381bbb3dad679285a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:34.037013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bb035acae63401381bbb3dad679285a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:34.129106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bb035acae63401381bbb3dad679285a'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:34.135600 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1327/2666] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:33 2021] DELETE /identity/v3/users/4bb035acae63401381bbb3dad679285a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:34.141198 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be936-ef56-4cf9-b585-2d4c7377d107 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:34.141672 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be936-ef56-4cf9-b585-2d4c7377d107 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:34.141798 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56be936-ef56-4cf9-b585-2d4c7377d107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:34.159470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-a56be936-ef56-4cf9-b585-2d4c7377d107 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:34.160649 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a56be936-ef56-4cf9-b585-2d4c7377d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:34.217829 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1340/2667] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:34.228172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:34.229618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:34.294055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e0352-7104-4629-b988-e6bf88992143 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:34.297826 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d37a34-3b5f-4df6-8aab-4c1f80eeac96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:34.298502 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d37a34-3b5f-4df6-8aab-4c1f80eeac96 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:34.298779 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d37a34-3b5f-4df6-8aab-4c1f80eeac96 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:34.301553 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d37a34-3b5f-4df6-8aab-4c1f80eeac96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:34.308094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d37a34-3b5f-4df6-8aab-4c1f80eeac96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:34.310009 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d37a34-3b5f-4df6-8aab-4c1f80eeac96 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:34.319345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1328/2668] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:34.811183 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be936-ef56-4cf9-b585-2d4c7377d107 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:34.815890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a56be936-ef56-4cf9-b585-2d4c7377d107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:34.824831 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56be936-ef56-4cf9-b585-2d4c7377d107 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:34.829358 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:34.830657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:34.830657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:34.830865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] PATH_INFO: `/v3/projects/6305641f997d4e7eab14932a42f0386a` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:34.831955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6305641f997d4e7eab14932a42f0386a)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:34.833861 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:34.972045 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6305641f997d4e7eab14932a42f0386a', 'request_id': 'req-3444a80f-0e0c-4e14-81e4-8d0c982849f8'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:34.979125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6305641f997d4e7eab14932a42f0386a', 'request_id': 'req-3444a80f-0e0c-4e14-81e4-8d0c982849f8'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:34.990822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6305641f997d4e7eab14932a42f0386a', 'request_id': 'req-3444a80f-0e0c-4e14-81e4-8d0c982849f8'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:35.082452 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] The token cache is being invalidate because project 6305641f997d4e7eab14932a42f0386a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:35.087022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:35.087022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:35.087022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1341/2669] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:34 2021] DELETE /identity/v3/projects/6305641f997d4e7eab14932a42f0386a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:26:35.089013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d37a34-3b5f-4df6-8aab-4c1f80eeac96 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:35.099641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d37a34-3b5f-4df6-8aab-4c1f80eeac96 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:35.154032 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:35.154909 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:35.155188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:35.155458 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] PATH_INFO: `/v3/users/9a232477595c4a3a9b8f8372814b2b43` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:35.156637 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a232477595c4a3a9b8f8372814b2b43)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:35.158561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:35.375807 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a232477595c4a3a9b8f8372814b2b43'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:35.387576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a232477595c4a3a9b8f8372814b2b43'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:35.396455 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a232477595c4a3a9b8f8372814b2b43'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:35.397169 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a232477595c4a3a9b8f8372814b2b43'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:35.488900 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-7c14bf80-9ae2-42f7-aeec-94129ab67380 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a232477595c4a3a9b8f8372814b2b43'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:35.495732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1329/2670] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:35 2021] DELETE /identity/v3/users/9a232477595c4a3a9b8f8372814b2b43 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:35.980135 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:35.982362 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:35.995038 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444a80f-0e0c-4e14-81e4-8d0c982849f8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:36.053163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:36.054180 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.054468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.054740 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] PATH_INFO: `/v3/projects/c8ed7ba5a8024f1c99b15bd363c5c780` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.055940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ed7ba5a8024f1c99b15bd363c5c780)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:36.057852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:36.169550 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ed7ba5a8024f1c99b15bd363c5c780', 'request_id': 'req-cb274732-0036-4d60-8cb8-82566856795f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:36.175693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ed7ba5a8024f1c99b15bd363c5c780', 'request_id': 'req-cb274732-0036-4d60-8cb8-82566856795f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:36.181277 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ed7ba5a8024f1c99b15bd363c5c780', 'request_id': 'req-cb274732-0036-4d60-8cb8-82566856795f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:36.257313 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] The token cache is being invalidate because project c8ed7ba5a8024f1c99b15bd363c5c780 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:36.257684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:36.258345 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-cb274732-0036-4d60-8cb8-82566856795f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:36.259910 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1342/2671] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:35 2021] DELETE /identity/v3/projects/c8ed7ba5a8024f1c99b15bd363c5c780 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:36.267250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9832-b0c7-46c3-ae70-b2bf6a345f75 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.267742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9832-b0c7-46c3-ae70-b2bf6a345f75 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.267842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ae9832-b0c7-46c3-ae70-b2bf6a345f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.288554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-03ae9832-b0c7-46c3-ae70-b2bf6a345f75 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:36.289747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-03ae9832-b0c7-46c3-ae70-b2bf6a345f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:36.348353 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1330/2672] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:36.358702 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fdc86-098e-4f26-ba12-53d493061ca4 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.358989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fdc86-098e-4f26-ba12-53d493061ca4 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.359289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989fdc86-098e-4f26-ba12-53d493061ca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.379708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-989fdc86-098e-4f26-ba12-53d493061ca4 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:36.380916 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-989fdc86-098e-4f26-ba12-53d493061ca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:36.388904 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1343/2673] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:36 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:36.393161 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9832-b0c7-46c3-ae70-b2bf6a345f75 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:36.402866 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ae9832-b0c7-46c3-ae70-b2bf6a345f75 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:36.407416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91677c9-ea36-475a-886b-87d0a98d757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:36.408056 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91677c9-ea36-475a-886b-87d0a98d757a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.408333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91677c9-ea36-475a-886b-87d0a98d757a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.408603 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91677c9-ea36-475a-886b-87d0a98d757a admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.409332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91677c9-ea36-475a-886b-87d0a98d757a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:36.409642 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91677c9-ea36-475a-886b-87d0a98d757a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:36.411246 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91677c9-ea36-475a-886b-87d0a98d757a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:36.423071 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1331/2674] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:26:36 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:36.427499 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fdc86-098e-4f26-ba12-53d493061ca4 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:36.437314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989fdc86-098e-4f26-ba12-53d493061ca4 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:36.441876 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee62635-afad-4942-8841-c3eb54887e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:36.442543 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62635-afad-4942-8841-c3eb54887e9e admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.442819 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62635-afad-4942-8841-c3eb54887e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.443088 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee62635-afad-4942-8841-c3eb54887e9e admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.443787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62635-afad-4942-8841-c3eb54887e9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:36.445633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee62635-afad-4942-8841-c3eb54887e9e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:36.558726 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1344/2675] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:36 2021] POST /identity/v3/projects => generated 375 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:36.562803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91677c9-ea36-475a-886b-87d0a98d757a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:36.573305 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91677c9-ea36-475a-886b-87d0a98d757a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:36.629493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb77ec0-3e50-4143-bd23-42c3edc0211c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:36.630190 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb77ec0-3e50-4143-bd23-42c3edc0211c admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.630471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb77ec0-3e50-4143-bd23-42c3edc0211c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.630745 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb77ec0-3e50-4143-bd23-42c3edc0211c admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.631435 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb77ec0-3e50-4143-bd23-42c3edc0211c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:36.633306 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb77ec0-3e50-4143-bd23-42c3edc0211c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:36.737763 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1332/2676] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:36 2021] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:36.738985 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee62635-afad-4942-8841-c3eb54887e9e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:36.749898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee62635-afad-4942-8841-c3eb54887e9e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:36.754396 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df9f2d-d038-4aa1-aac2-c4e63e615fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:36.755053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df9f2d-d038-4aa1-aac2-c4e63e615fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.755326 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df9f2d-d038-4aa1-aac2-c4e63e615fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.755594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56df9f2d-d038-4aa1-aac2-c4e63e615fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.756372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df9f2d-d038-4aa1-aac2-c4e63e615fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:36.757932 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56df9f2d-d038-4aa1-aac2-c4e63e615fa8 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:36.768989 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1345/2677] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:36.773198 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb77ec0-3e50-4143-bd23-42c3edc0211c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:36.783773 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb77ec0-3e50-4143-bd23-42c3edc0211c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:36.788489 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd908b9-6e17-4dae-911d-f744f00a3835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:36.789128 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd908b9-6e17-4dae-911d-f744f00a3835 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.789408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd908b9-6e17-4dae-911d-f744f00a3835 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.789704 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd908b9-6e17-4dae-911d-f744f00a3835 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.790478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd908b9-6e17-4dae-911d-f744f00a3835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:36.792047 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd908b9-6e17-4dae-911d-f744f00a3835 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:36.802860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1333/2678] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:36 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:36.806923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df9f2d-d038-4aa1-aac2-c4e63e615fa8 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:36.816704 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56df9f2d-d038-4aa1-aac2-c4e63e615fa8 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:36.821201 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3e00-510d-49cf-886f-02f80e0e5b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:36.822118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3e00-510d-49cf-886f-02f80e0e5b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.822419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3e00-510d-49cf-886f-02f80e0e5b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.822693 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da3e00-510d-49cf-886f-02f80e0e5b8d admin admin] PATH_INFO: `/v3/projects/68865d62b9a74ad19f284c6b3c916eb3/users/f2032bb445a54d159a4a610cf9f5bddf/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.838232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da3e00-510d-49cf-886f-02f80e0e5b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68865d62b9a74ad19f284c6b3c916eb3, user_id=f2032bb445a54d159a4a610cf9f5bddf, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:36.842064 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da3e00-510d-49cf-886f-02f80e0e5b8d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:36.940701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1346/2679] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:36 2021] PUT /identity/v3/projects/68865d62b9a74ad19f284c6b3c916eb3/users/f2032bb445a54d159a4a610cf9f5bddf/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:36.953238 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629bc49-3c6d-41c5-a510-3b15a70ae0e2 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:36.953594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629bc49-3c6d-41c5-a510-3b15a70ae0e2 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:36.953937 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4629bc49-3c6d-41c5-a510-3b15a70ae0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:36.981555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-4629bc49-3c6d-41c5-a510-3b15a70ae0e2 None None] MFA Rules not processed for user `f2032bb445a54d159a4a610cf9f5bddf`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:36.982809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4629bc49-3c6d-41c5-a510-3b15a70ae0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:37.045992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1334/2680] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:36 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:37.057671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3e00-510d-49cf-886f-02f80e0e5b8d admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:37.059591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-07da3e00-510d-49cf-886f-02f80e0e5b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:37.114966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da3e00-510d-49cf-886f-02f80e0e5b8d admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:37.118771 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8431b7-2593-40d1-a685-10b58caf1ab0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9f402e17093e4e99afda5ea019f335eb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:37.119416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8431b7-2593-40d1-a685-10b58caf1ab0 service glance] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:37.119695 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8431b7-2593-40d1-a685-10b58caf1ab0 service glance] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:37.120120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8431b7-2593-40d1-a685-10b58caf1ab0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:37.129054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8431b7-2593-40d1-a685-10b58caf1ab0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:37.130633 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8431b7-2593-40d1-a685-10b58caf1ab0 service glance] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:37.140576 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1347/2681] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:37 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:38.001268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629bc49-3c6d-41c5-a510-3b15a70ae0e2 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:38.003276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4629bc49-3c6d-41c5-a510-3b15a70ae0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:38.072461 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4629bc49-3c6d-41c5-a510-3b15a70ae0e2 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:38.077471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:38.078352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:38.078626 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:38.078896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] PATH_INFO: `/v3/users/53c249a9d203460c983f174ae259e002` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:38.080063 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53c249a9d203460c983f174ae259e002)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:38.081937 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:38.370366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53c249a9d203460c983f174ae259e002'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:38.382872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53c249a9d203460c983f174ae259e002'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:38.390874 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53c249a9d203460c983f174ae259e002'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:38.391596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53c249a9d203460c983f174ae259e002'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:38.502822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53c249a9d203460c983f174ae259e002'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:38.505129 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1335/2682] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:38 2021] DELETE /identity/v3/users/53c249a9d203460c983f174ae259e002 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:38.509896 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936739be-d777-4e2b-bc7b-e87b209f6b37 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:38.510441 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936739be-d777-4e2b-bc7b-e87b209f6b37 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:38.510551 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936739be-d777-4e2b-bc7b-e87b209f6b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:38.528335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-936739be-d777-4e2b-bc7b-e87b209f6b37 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:38.533263 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-936739be-d777-4e2b-bc7b-e87b209f6b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:38.587503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1348/2683] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:38 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:26:38.597322 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:38.598705 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:38.656842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9a273-8595-4fa4-9d0e-b9816bbd6678 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:38.660554 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b89f06-f750-4ff9-8247-c2b8986b47fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:38.661191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b89f06-f750-4ff9-8247-c2b8986b47fd service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:38.661467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b89f06-f750-4ff9-8247-c2b8986b47fd service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:38.661734 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b89f06-f750-4ff9-8247-c2b8986b47fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:38.671651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b89f06-f750-4ff9-8247-c2b8986b47fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:38.673084 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b89f06-f750-4ff9-8247-c2b8986b47fd service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:38.682619 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1336/2684] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:38 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:39.146095 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936739be-d777-4e2b-bc7b-e87b209f6b37 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:39.147482 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-936739be-d777-4e2b-bc7b-e87b209f6b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:39.159930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936739be-d777-4e2b-bc7b-e87b209f6b37 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:39.164703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:39.165575 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.165851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.166154 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] PATH_INFO: `/v3/projects/a98ca56cd18a44858f24a67eb6864248` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.167409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a98ca56cd18a44858f24a67eb6864248)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:39.169337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:39.284128 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a98ca56cd18a44858f24a67eb6864248', 'request_id': 'req-d438892d-e3be-4068-8ecd-cb0880601035'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:39.290316 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a98ca56cd18a44858f24a67eb6864248', 'request_id': 'req-d438892d-e3be-4068-8ecd-cb0880601035'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:39.295588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a98ca56cd18a44858f24a67eb6864248', 'request_id': 'req-d438892d-e3be-4068-8ecd-cb0880601035'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:39.380383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] The token cache is being invalidate because project a98ca56cd18a44858f24a67eb6864248 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:39.380625 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:39.381349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d438892d-e3be-4068-8ecd-cb0880601035 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:39.382984 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1349/2685] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:39 2021] DELETE /identity/v3/projects/a98ca56cd18a44858f24a67eb6864248 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:39.389383 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffd545-6036-4237-9377-d1e7777c7f86 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.389861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffd545-6036-4237-9377-d1e7777c7f86 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.392041 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fffd545-6036-4237-9377-d1e7777c7f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.407868 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-2fffd545-6036-4237-9377-d1e7777c7f86 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:39.409046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2fffd545-6036-4237-9377-d1e7777c7f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:39.467386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1337/2686] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:39.475474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2412b-844a-4f94-a5c6-008f3138a1a0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.475760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2412b-844a-4f94-a5c6-008f3138a1a0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.476029 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e2412b-844a-4f94-a5c6-008f3138a1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.494361 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-15e2412b-844a-4f94-a5c6-008f3138a1a0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:39.495557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-15e2412b-844a-4f94-a5c6-008f3138a1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:39.503868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1350/2687] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:39 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:39.508147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffd545-6036-4237-9377-d1e7777c7f86 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:39.518759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fffd545-6036-4237-9377-d1e7777c7f86 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:39.523416 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf768a-f717-48b2-ad0a-5e2f7ff75c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:39.524073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf768a-f717-48b2-ad0a-5e2f7ff75c06 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.524345 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf768a-f717-48b2-ad0a-5e2f7ff75c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.524611 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebf768a-f717-48b2-ad0a-5e2f7ff75c06 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.525334 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf768a-f717-48b2-ad0a-5e2f7ff75c06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:39.525634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf768a-f717-48b2-ad0a-5e2f7ff75c06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:39.527245 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebf768a-f717-48b2-ad0a-5e2f7ff75c06 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:39.538860 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1338/2688] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:26:39 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:39.543387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2412b-844a-4f94-a5c6-008f3138a1a0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:39.553416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e2412b-844a-4f94-a5c6-008f3138a1a0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:39.559182 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d140ed0-793a-43a2-b7b4-30c51ebffec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:39.560125 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d140ed0-793a-43a2-b7b4-30c51ebffec3 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.562068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d140ed0-793a-43a2-b7b4-30c51ebffec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.562068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d140ed0-793a-43a2-b7b4-30c51ebffec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.562068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d140ed0-793a-43a2-b7b4-30c51ebffec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:39.563550 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d140ed0-793a-43a2-b7b4-30c51ebffec3 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:39.676148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1351/2689] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:39 2021] POST /identity/v3/projects => generated 375 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:39.677172 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf768a-f717-48b2-ad0a-5e2f7ff75c06 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:39.687916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebf768a-f717-48b2-ad0a-5e2f7ff75c06 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:39.751317 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8f93f-664b-408c-908b-5b8b2961babc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:39.752013 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8f93f-664b-408c-908b-5b8b2961babc admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.752293 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8f93f-664b-408c-908b-5b8b2961babc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.752566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8f93f-664b-408c-908b-5b8b2961babc admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.753291 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8f93f-664b-408c-908b-5b8b2961babc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:39.755241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8f93f-664b-408c-908b-5b8b2961babc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:39.848101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1339/2690] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:39 2021] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:39.852205 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d140ed0-793a-43a2-b7b4-30c51ebffec3 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:39.862423 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d140ed0-793a-43a2-b7b4-30c51ebffec3 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:39.867844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd24e0-5ea6-4da1-93af-d7d1b254ba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:39.868546 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd24e0-5ea6-4da1-93af-d7d1b254ba56 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.868855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd24e0-5ea6-4da1-93af-d7d1b254ba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.869131 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd24e0-5ea6-4da1-93af-d7d1b254ba56 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.869881 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd24e0-5ea6-4da1-93af-d7d1b254ba56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:39.872469 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd24e0-5ea6-4da1-93af-d7d1b254ba56 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:39.873393 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8f93f-664b-408c-908b-5b8b2961babc admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:39.875216 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1cc8f93f-664b-408c-908b-5b8b2961babc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:39.883457 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1352/2691] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:39 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:39.888416 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd24e0-5ea6-4da1-93af-d7d1b254ba56 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:39.897915 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd24e0-5ea6-4da1-93af-d7d1b254ba56 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:39.902601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8497589-3944-4dba-946b-3dfd7d723664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:39.903398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8497589-3944-4dba-946b-3dfd7d723664 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.903703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8497589-3944-4dba-946b-3dfd7d723664 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.903981 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8497589-3944-4dba-946b-3dfd7d723664 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.904772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8497589-3944-4dba-946b-3dfd7d723664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:39.906398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8497589-3944-4dba-946b-3dfd7d723664 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:39.917697 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1353/2692] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:39 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:26:39.922253 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8497589-3944-4dba-946b-3dfd7d723664 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:39.931882 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8497589-3944-4dba-946b-3dfd7d723664 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:39.935371 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8f93f-664b-408c-908b-5b8b2961babc admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:39.937226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf2a1d-f990-485f-ab42-4515a7ba7669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:39.938120 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2a1d-f990-485f-ab42-4515a7ba7669 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.938471 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2a1d-f990-485f-ab42-4515a7ba7669 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.938858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bf2a1d-f990-485f-ab42-4515a7ba7669 admin admin] PATH_INFO: `/v3/projects/ee50a81eec244796a3b3222c03960221/users/34b7f19ee3ce458da40d95e891a5d2f5/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.939188 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694c456-97c6-4538-970d-2e82756e67b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:39.939840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c456-97c6-4538-970d-2e82756e67b0 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:39.940118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c456-97c6-4538-970d-2e82756e67b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:39.940388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694c456-97c6-4538-970d-2e82756e67b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:39.942212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f694c456-97c6-4538-970d-2e82756e67b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:39.954076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf2a1d-f990-485f-ab42-4515a7ba7669 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee50a81eec244796a3b3222c03960221, user_id=34b7f19ee3ce458da40d95e891a5d2f5, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:39.956725 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bf2a1d-f990-485f-ab42-4515a7ba7669 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:40.005629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694c456-97c6-4538-970d-2e82756e67b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:40.007109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694c456-97c6-4538-970d-2e82756e67b0 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:40.017980 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1340/2693] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:39 2021] GET /identity/v3/auth/tokens => generated 3464 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:26:40.060721 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1354/2694] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:39 2021] PUT /identity/v3/projects/ee50a81eec244796a3b3222c03960221/users/34b7f19ee3ce458da40d95e891a5d2f5/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:26:40.071015 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11caa-36ec-47b2-b61c-fea3ae65394d None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:40.071304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11caa-36ec-47b2-b61c-fea3ae65394d None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:40.071584 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11caa-36ec-47b2-b61c-fea3ae65394d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:40.099731 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-e1c11caa-36ec-47b2-b61c-fea3ae65394d None None] MFA Rules not processed for user `34b7f19ee3ce458da40d95e891a5d2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:40.100956 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e1c11caa-36ec-47b2-b61c-fea3ae65394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:40.165017 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1341/2695] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:40 2021] POST /identity/v3/auth/tokens => generated 3395 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:40.175099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf2a1d-f990-485f-ab42-4515a7ba7669 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:40.176871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-e6bf2a1d-f990-485f-ab42-4515a7ba7669 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:40.236133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bf2a1d-f990-485f-ab42-4515a7ba7669 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:40.239845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3385-e666-4500-bb47-d2f8f634c3ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:40.240488 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3385-e666-4500-bb47-d2f8f634c3ab service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:40.240840 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3385-e666-4500-bb47-d2f8f634c3ab service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:40.241119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f3385-e666-4500-bb47-d2f8f634c3ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:40.250997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3385-e666-4500-bb47-d2f8f634c3ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:40.252783 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f3385-e666-4500-bb47-d2f8f634c3ab service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:40.263290 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1355/2696] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:40 2021] GET /identity/v3/auth/tokens => generated 3395 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:42.036402 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c11caa-36ec-47b2-b61c-fea3ae65394d None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:42.037831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-e1c11caa-36ec-47b2-b61c-fea3ae65394d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:42.112623 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c11caa-36ec-47b2-b61c-fea3ae65394d None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:42.118716 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10529d4f-5603-4484-a4d2-5ef256db5cc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:42.119376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10529d4f-5603-4484-a4d2-5ef256db5cc4 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:42.119652 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10529d4f-5603-4484-a4d2-5ef256db5cc4 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:42.120053 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10529d4f-5603-4484-a4d2-5ef256db5cc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:42.124182 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-10529d4f-5603-4484-a4d2-5ef256db5cc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:42.142388 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10529d4f-5603-4484-a4d2-5ef256db5cc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:42.145470 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10529d4f-5603-4484-a4d2-5ef256db5cc4 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:42.156841 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1342/2697] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:42 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:44.599849 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3385-e666-4500-bb47-d2f8f634c3ab service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:44.662348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f3385-e666-4500-bb47-d2f8f634c3ab service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:44.667082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:44.668041 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:44.668317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:44.668638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] PATH_INFO: `/v3/users/34b7f19ee3ce458da40d95e891a5d2f5` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:44.669839 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34b7f19ee3ce458da40d95e891a5d2f5)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:44.671826 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:44.861858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34b7f19ee3ce458da40d95e891a5d2f5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:44.874311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34b7f19ee3ce458da40d95e891a5d2f5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:44.880979 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34b7f19ee3ce458da40d95e891a5d2f5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:44.962867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34b7f19ee3ce458da40d95e891a5d2f5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:44.963474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34b7f19ee3ce458da40d95e891a5d2f5'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:44.970005 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1356/2698] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:44 2021] DELETE /identity/v3/users/34b7f19ee3ce458da40d95e891a5d2f5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:44.975781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8e2a8-0dff-4459-98ee-78c78b344c08 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:44.976312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8e2a8-0dff-4459-98ee-78c78b344c08 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:44.976312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac8e2a8-0dff-4459-98ee-78c78b344c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:44.993411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-bac8e2a8-0dff-4459-98ee-78c78b344c08 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:44.994754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-bac8e2a8-0dff-4459-98ee-78c78b344c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:45.053209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1343/2699] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:44 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:45.063437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:45.064800 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:45.123334 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc1c58-922c-4cd1-8b0d-1b8204237465 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:45.126893 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d32a-45b8-49b8-bad7-d0399a5df641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:45.127553 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d32a-45b8-49b8-bad7-d0399a5df641 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.127807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d32a-45b8-49b8-bad7-d0399a5df641 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.128076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d32a-45b8-49b8-bad7-d0399a5df641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.137758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8d32a-45b8-49b8-bad7-d0399a5df641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:45.139203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8d32a-45b8-49b8-bad7-d0399a5df641 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:45.148410 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1357/2700] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:45 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:45.554396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8e2a8-0dff-4459-98ee-78c78b344c08 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:45.556440 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-bac8e2a8-0dff-4459-98ee-78c78b344c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:45.570162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac8e2a8-0dff-4459-98ee-78c78b344c08 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:45.576436 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:45.577522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.577988 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.578286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] PATH_INFO: `/v3/projects/ee50a81eec244796a3b3222c03960221` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.579858 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee50a81eec244796a3b3222c03960221)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:45.581522 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:45.687069 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee50a81eec244796a3b3222c03960221', 'request_id': 'req-821aba59-ba0b-4b03-9878-abc0861bb575'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:45.693576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee50a81eec244796a3b3222c03960221', 'request_id': 'req-821aba59-ba0b-4b03-9878-abc0861bb575'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:45.699691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee50a81eec244796a3b3222c03960221', 'request_id': 'req-821aba59-ba0b-4b03-9878-abc0861bb575'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:45.768928 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] The token cache is being invalidate because project ee50a81eec244796a3b3222c03960221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:45.769206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:45.769809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-821aba59-ba0b-4b03-9878-abc0861bb575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:45.771377 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1344/2701] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:45 2021] DELETE /identity/v3/projects/ee50a81eec244796a3b3222c03960221 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:45.778790 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aaed0-912c-4c3a-906e-ea0910d0ed40 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.779295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aaed0-912c-4c3a-906e-ea0910d0ed40 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.779295 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5aaed0-912c-4c3a-906e-ea0910d0ed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.798325 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-9a5aaed0-912c-4c3a-906e-ea0910d0ed40 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:45.799504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9a5aaed0-912c-4c3a-906e-ea0910d0ed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:45.859170 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1358/2702] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:45.868297 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6661f90-04b9-4369-9d7a-3daf78014a52 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.868667 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6661f90-04b9-4369-9d7a-3daf78014a52 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.868963 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6661f90-04b9-4369-9d7a-3daf78014a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.888366 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d6661f90-04b9-4369-9d7a-3daf78014a52 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:45.889564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d6661f90-04b9-4369-9d7a-3daf78014a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:45.897312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1345/2703] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:45 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:45.901512 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aaed0-912c-4c3a-906e-ea0910d0ed40 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:45.911359 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5aaed0-912c-4c3a-906e-ea0910d0ed40 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:45.916458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72946db2-aadf-43ce-bc6f-4188c9c13183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:45.917320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72946db2-aadf-43ce-bc6f-4188c9c13183 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.918342 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72946db2-aadf-43ce-bc6f-4188c9c13183 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.918746 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72946db2-aadf-43ce-bc6f-4188c9c13183 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.919496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72946db2-aadf-43ce-bc6f-4188c9c13183 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:45.919809 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72946db2-aadf-43ce-bc6f-4188c9c13183 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:45.921429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72946db2-aadf-43ce-bc6f-4188c9c13183 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:45.933238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1359/2704] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:26:45 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:45.938482 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6661f90-04b9-4369-9d7a-3daf78014a52 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:45.947391 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6661f90-04b9-4369-9d7a-3daf78014a52 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:45.952486 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef1831-5e60-40c3-8434-79354501a0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:45.953139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef1831-5e60-40c3-8434-79354501a0b4 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:45.953426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef1831-5e60-40c3-8434-79354501a0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:45.953700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef1831-5e60-40c3-8434-79354501a0b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:45.954478 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef1831-5e60-40c3-8434-79354501a0b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:45.956358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ef1831-5e60-40c3-8434-79354501a0b4 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:46.036709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1346/2705] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:45 2021] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:26:46.040902 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72946db2-aadf-43ce-bc6f-4188c9c13183 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:46.051458 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72946db2-aadf-43ce-bc6f-4188c9c13183 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:46.107113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274bda8-3c23-4859-a8ce-14b23d3caefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:46.107822 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274bda8-3c23-4859-a8ce-14b23d3caefe admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:46.108099 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274bda8-3c23-4859-a8ce-14b23d3caefe admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:46.108372 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274bda8-3c23-4859-a8ce-14b23d3caefe admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:46.109076 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274bda8-3c23-4859-a8ce-14b23d3caefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:46.111050 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6274bda8-3c23-4859-a8ce-14b23d3caefe admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:46.223939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1360/2706] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:46 2021] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:46.228183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef1831-5e60-40c3-8434-79354501a0b4 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:46.240145 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef1831-5e60-40c3-8434-79354501a0b4 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:46.244972 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac744d9-3a7f-436b-893d-acfde9fe2bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:46.245638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac744d9-3a7f-436b-893d-acfde9fe2bea admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:46.246668 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac744d9-3a7f-436b-893d-acfde9fe2bea admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:46.247168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac744d9-3a7f-436b-893d-acfde9fe2bea admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:46.248000 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac744d9-3a7f-436b-893d-acfde9fe2bea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:46.249614 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac744d9-3a7f-436b-893d-acfde9fe2bea admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:46.260156 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1347/2707] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:46 2021] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:46.264539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274bda8-3c23-4859-a8ce-14b23d3caefe admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:46.275332 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274bda8-3c23-4859-a8ce-14b23d3caefe admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:46.280627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cabdf0-c91d-423b-ba0f-0409e8dbec5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:46.281291 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cabdf0-c91d-423b-ba0f-0409e8dbec5a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:46.281572 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cabdf0-c91d-423b-ba0f-0409e8dbec5a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:46.281844 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cabdf0-c91d-423b-ba0f-0409e8dbec5a admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:46.282610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cabdf0-c91d-423b-ba0f-0409e8dbec5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:46.284185 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cabdf0-c91d-423b-ba0f-0409e8dbec5a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:46.295082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1361/2708] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:46 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:46.299337 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac744d9-3a7f-436b-893d-acfde9fe2bea admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:46.309611 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac744d9-3a7f-436b-893d-acfde9fe2bea admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:46.314747 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f38fce-9cce-4a8d-b8c9-1dcce34fffb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:46.315670 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f38fce-9cce-4a8d-b8c9-1dcce34fffb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:46.315951 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f38fce-9cce-4a8d-b8c9-1dcce34fffb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:46.316252 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f38fce-9cce-4a8d-b8c9-1dcce34fffb9 admin admin] PATH_INFO: `/v3/projects/49830343f83e41c79f1cbe51c57fb2d8/users/835721e1594749c08148db698789bb29/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:46.331977 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f38fce-9cce-4a8d-b8c9-1dcce34fffb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49830343f83e41c79f1cbe51c57fb2d8, user_id=835721e1594749c08148db698789bb29, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:46.335206 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f38fce-9cce-4a8d-b8c9-1dcce34fffb9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:46.452403 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1348/2709] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:46 2021] PUT /identity/v3/projects/49830343f83e41c79f1cbe51c57fb2d8/users/835721e1594749c08148db698789bb29/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:46.462641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0687f2-1127-4804-91db-5305cfe0ec8a None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:46.462929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0687f2-1127-4804-91db-5305cfe0ec8a None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:46.463210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0687f2-1127-4804-91db-5305cfe0ec8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:46.491887 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-4e0687f2-1127-4804-91db-5305cfe0ec8a None None] MFA Rules not processed for user `835721e1594749c08148db698789bb29`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:46.493001 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-4e0687f2-1127-4804-91db-5305cfe0ec8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:46.555634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1362/2710] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:46 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:46.566769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f38fce-9cce-4a8d-b8c9-1dcce34fffb9 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:46.568459 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-69f38fce-9cce-4a8d-b8c9-1dcce34fffb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:46.625872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f38fce-9cce-4a8d-b8c9-1dcce34fffb9 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:46.629687 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713cd05-c2c7-471b-97e6-c492fd2476b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:46.630370 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713cd05-c2c7-471b-97e6-c492fd2476b4 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:46.630648 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713cd05-c2c7-471b-97e6-c492fd2476b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:46.630918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713cd05-c2c7-471b-97e6-c492fd2476b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:46.640024 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713cd05-c2c7-471b-97e6-c492fd2476b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:46.641686 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713cd05-c2c7-471b-97e6-c492fd2476b4 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:46.650819 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1349/2711] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:46 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:46.677473 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0687f2-1127-4804-91db-5305cfe0ec8a None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:46.740355 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0687f2-1127-4804-91db-5305cfe0ec8a None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:46.744991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:46.745819 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:46.746132 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:46.746400 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] PATH_INFO: `/v3/users/835721e1594749c08148db698789bb29` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:46.747599 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=835721e1594749c08148db698789bb29)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:46.749498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:46.942588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '835721e1594749c08148db698789bb29'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:46.954659 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '835721e1594749c08148db698789bb29'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:46.962176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '835721e1594749c08148db698789bb29'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:47.060586 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '835721e1594749c08148db698789bb29'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:47.061226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '835721e1594749c08148db698789bb29'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:47.067683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1363/2712] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:46 2021] DELETE /identity/v3/users/835721e1594749c08148db698789bb29 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:47.072298 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1c18-e333-45a2-9bd8-61f2369d2f83 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:47.072802 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1c18-e333-45a2-9bd8-61f2369d2f83 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:47.072922 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35f1c18-e333-45a2-9bd8-61f2369d2f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:47.090744 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-b35f1c18-e333-45a2-9bd8-61f2369d2f83 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:47.091937 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b35f1c18-e333-45a2-9bd8-61f2369d2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:47.150994 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1350/2713] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:47.161046 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:47.162496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:47.218722 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018e023a-cd49-404a-bfff-921c6f67cba1 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:47.222500 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f296a4-6538-4fbc-83ca-e435c846c382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:47.223155 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f296a4-6538-4fbc-83ca-e435c846c382 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:47.223434 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f296a4-6538-4fbc-83ca-e435c846c382 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:47.223706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f296a4-6538-4fbc-83ca-e435c846c382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:47.232765 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f296a4-6538-4fbc-83ca-e435c846c382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:47.234228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f296a4-6538-4fbc-83ca-e435c846c382 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:47.244320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1364/2714] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:47 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:47.719066 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f1c18-e333-45a2-9bd8-61f2369d2f83 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:47.720601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b35f1c18-e333-45a2-9bd8-61f2369d2f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:47.734823 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35f1c18-e333-45a2-9bd8-61f2369d2f83 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:47.739638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:47.740497 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:47.740771 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:47.741038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] PATH_INFO: `/v3/projects/49830343f83e41c79f1cbe51c57fb2d8` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:47.742264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49830343f83e41c79f1cbe51c57fb2d8)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:47.744214 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:47.852505 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49830343f83e41c79f1cbe51c57fb2d8', 'request_id': 'req-9ff672c4-528f-4d0a-95e6-3f27e3970f62'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:47.859276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49830343f83e41c79f1cbe51c57fb2d8', 'request_id': 'req-9ff672c4-528f-4d0a-95e6-3f27e3970f62'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:47.864608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49830343f83e41c79f1cbe51c57fb2d8', 'request_id': 'req-9ff672c4-528f-4d0a-95e6-3f27e3970f62'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:47.965995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] The token cache is being invalidate because project 49830343f83e41c79f1cbe51c57fb2d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79890) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:47.966314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:47.966924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-9ff672c4-528f-4d0a-95e6-3f27e3970f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:47.968446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1351/2715] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:47 2021] DELETE /identity/v3/projects/49830343f83e41c79f1cbe51c57fb2d8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:47.974453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e56e6-4bb1-4b9f-9376-7be06717df81 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:47.974955 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e56e6-4bb1-4b9f-9376-7be06717df81 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:47.975057 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435e56e6-4bb1-4b9f-9376-7be06717df81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:47.999735 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-435e56e6-4bb1-4b9f-9376-7be06717df81 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:48.000934 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-435e56e6-4bb1-4b9f-9376-7be06717df81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:48.060814 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1365/2716] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:47 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:48.068803 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d19c39-1747-468f-b0ff-3bec9aa9b28e None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:48.069090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d19c39-1747-468f-b0ff-3bec9aa9b28e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:48.069367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d19c39-1747-468f-b0ff-3bec9aa9b28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:48.088645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-d1d19c39-1747-468f-b0ff-3bec9aa9b28e None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:48.090168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-d1d19c39-1747-468f-b0ff-3bec9aa9b28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:48.098736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1352/2717] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:48.103376 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e56e6-4bb1-4b9f-9376-7be06717df81 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:48.113364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435e56e6-4bb1-4b9f-9376-7be06717df81 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:48.118130 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330057ac-d339-43c1-b68f-0943b9da5b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:48.118775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330057ac-d339-43c1-b68f-0943b9da5b87 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:48.119054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330057ac-d339-43c1-b68f-0943b9da5b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:48.119323 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330057ac-d339-43c1-b68f-0943b9da5b87 admin admin] PATH_INFO: `/v3/domains` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:48.120082 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330057ac-d339-43c1-b68f-0943b9da5b87 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79889) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:48.120386 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330057ac-d339-43c1-b68f-0943b9da5b87 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:48.122971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330057ac-d339-43c1-b68f-0943b9da5b87 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:48.134308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1366/2718] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:26:48 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:26:48.138933 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d19c39-1747-468f-b0ff-3bec9aa9b28e None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:48.148160 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d19c39-1747-468f-b0ff-3bec9aa9b28e None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:48.152975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac237da8-b9f5-497d-a9d1-7b9563185632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:48.153618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237da8-b9f5-497d-a9d1-7b9563185632 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:48.153898 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237da8-b9f5-497d-a9d1-7b9563185632 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:48.154209 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac237da8-b9f5-497d-a9d1-7b9563185632 admin admin] PATH_INFO: `/v3/projects` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:48.154918 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac237da8-b9f5-497d-a9d1-7b9563185632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:48.156777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac237da8-b9f5-497d-a9d1-7b9563185632 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:48.255043 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1353/2719] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:48 2021] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:26:48.259139 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330057ac-d339-43c1-b68f-0943b9da5b87 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:48.269394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330057ac-d339-43c1-b68f-0943b9da5b87 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:48.329775 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108931-a5e8-4e95-8032-293a95540dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:48.330468 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108931-a5e8-4e95-8032-293a95540dae admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:48.330852 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108931-a5e8-4e95-8032-293a95540dae admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:48.331119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1108931-a5e8-4e95-8032-293a95540dae admin admin] PATH_INFO: `/v3/users` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:48.331823 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108931-a5e8-4e95-8032-293a95540dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:48.334760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1108931-a5e8-4e95-8032-293a95540dae admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:48.477860 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1367/2720] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:48 2021] POST /identity/v3/users => generated 292 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:48.482454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac237da8-b9f5-497d-a9d1-7b9563185632 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:48.492634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac237da8-b9f5-497d-a9d1-7b9563185632 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:48.498466 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d057a-6d67-4c04-a5a9-5d6ec4c42f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:48.499142 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d057a-6d67-4c04-a5a9-5d6ec4c42f1f admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:48.499452 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d057a-6d67-4c04-a5a9-5d6ec4c42f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:48.499728 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d057a-6d67-4c04-a5a9-5d6ec4c42f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:48.500555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d057a-6d67-4c04-a5a9-5d6ec4c42f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:48.502162 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d057a-6d67-4c04-a5a9-5d6ec4c42f1f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:48.513358 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1354/2721] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:48.517692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108931-a5e8-4e95-8032-293a95540dae admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:48.527496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1108931-a5e8-4e95-8032-293a95540dae admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:48.532289 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b8c08-1e43-4fb5-bd22-ee71ef8d843a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:48.532966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b8c08-1e43-4fb5-bd22-ee71ef8d843a admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:48.533250 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b8c08-1e43-4fb5-bd22-ee71ef8d843a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:48.533554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b8c08-1e43-4fb5-bd22-ee71ef8d843a admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:48.534328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b8c08-1e43-4fb5-bd22-ee71ef8d843a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:48.535983 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43b8c08-1e43-4fb5-bd22-ee71ef8d843a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:48.550248 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1368/2722] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:48 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:26:48.551782 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d057a-6d67-4c04-a5a9-5d6ec4c42f1f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:48.561781 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d057a-6d67-4c04-a5a9-5d6ec4c42f1f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:48.566257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb29b6-f357-4e43-bfa4-f5febe789dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:48.567120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb29b6-f357-4e43-bfa4-f5febe789dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:48.567396 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb29b6-f357-4e43-bfa4-f5febe789dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:48.567663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb29b6-f357-4e43-bfa4-f5febe789dd7 admin admin] PATH_INFO: `/v3/projects/0201f20f8a2e46e6a8ceb7bccf7659df/users/a6fb31f457cb4c268d6f4e06bf5ee703/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:48.583391 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb29b6-f357-4e43-bfa4-f5febe789dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0201f20f8a2e46e6a8ceb7bccf7659df, user_id=a6fb31f457cb4c268d6f4e06bf5ee703, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:48.585989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacb29b6-f357-4e43-bfa4-f5febe789dd7 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:48.675816 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1355/2723] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:48 2021] PUT /identity/v3/projects/0201f20f8a2e46e6a8ceb7bccf7659df/users/a6fb31f457cb4c268d6f4e06bf5ee703/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:26:48.681271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf29f-0ba1-4e7f-9be4-4b979a408b0f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:48.681556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf29f-0ba1-4e7f-9be4-4b979a408b0f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:48.681830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bf29f-0ba1-4e7f-9be4-4b979a408b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:48.699432 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-608bf29f-0ba1-4e7f-9be4-4b979a408b0f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:48.700650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-608bf29f-0ba1-4e7f-9be4-4b979a408b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:48.759092 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1369/2724] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:48 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:48.768890 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb29b6-f357-4e43-bfa4-f5febe789dd7 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:48.770610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-bacb29b6-f357-4e43-bfa4-f5febe789dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:48.826789 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacb29b6-f357-4e43-bfa4-f5febe789dd7 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:48.830524 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203438f0-cd9f-4b50-8350-33112343a882 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:48.831197 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203438f0-cd9f-4b50-8350-33112343a882 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:48.831476 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203438f0-cd9f-4b50-8350-33112343a882 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:48.831749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203438f0-cd9f-4b50-8350-33112343a882 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:48.841645 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203438f0-cd9f-4b50-8350-33112343a882 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:48.843094 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203438f0-cd9f-4b50-8350-33112343a882 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:48.852556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1356/2725] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:48 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:26:50.153485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c54f9-3993-48c1-8670-7de13f7b381e None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:50.154059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c54f9-3993-48c1-8670-7de13f7b381e None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:50.154059 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7c54f9-3993-48c1-8670-7de13f7b381e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:50.182288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-0a7c54f9-3993-48c1-8670-7de13f7b381e None None] MFA Rules not processed for user `a6fb31f457cb4c268d6f4e06bf5ee703`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:50.183689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-0a7c54f9-3993-48c1-8670-7de13f7b381e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:50.256554 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1370/2726] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:50 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:50.263808 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203438f0-cd9f-4b50-8350-33112343a882 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:50.266125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-203438f0-cd9f-4b50-8350-33112343a882 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:50.324799 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203438f0-cd9f-4b50-8350-33112343a882 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:50.328526 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd01e-60ec-4d5f-a925-700bee8573a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:50.329174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd01e-60ec-4d5f-a925-700bee8573a8 service cinder] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:50.329454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd01e-60ec-4d5f-a925-700bee8573a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:50.329753 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300bd01e-60ec-4d5f-a925-700bee8573a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:50.338098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bd01e-60ec-4d5f-a925-700bee8573a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:50.340089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300bd01e-60ec-4d5f-a925-700bee8573a8 service cinder] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:50.349127 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1357/2727] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:50 2021] GET /identity/v3/auth/tokens => generated 3403 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:52.095688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77094ac-39ea-45ac-b2b5-34d07fd6e592 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:52.096228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77094ac-39ea-45ac-b2b5-34d07fd6e592 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:52.096228 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77094ac-39ea-45ac-b2b5-34d07fd6e592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:52.118827 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-d77094ac-39ea-45ac-b2b5-34d07fd6e592 None None] MFA Rules not processed for user `a6fb31f457cb4c268d6f4e06bf5ee703`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:52.120007 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d77094ac-39ea-45ac-b2b5-34d07fd6e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:52.127452 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1371/2728] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:52 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:57.606720 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd01e-60ec-4d5f-a925-700bee8573a8 service cinder] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:57.608175 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-300bd01e-60ec-4d5f-a925-700bee8573a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:57.622514 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300bd01e-60ec-4d5f-a925-700bee8573a8 service cinder] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:57.627021 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:57.627870 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:57.628153 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:57.628426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] PATH_INFO: `/v3/users/f2032bb445a54d159a4a610cf9f5bddf` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:57.629608 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2032bb445a54d159a4a610cf9f5bddf)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:57.631525 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:57.786433 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2032bb445a54d159a4a610cf9f5bddf'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:57.797766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2032bb445a54d159a4a610cf9f5bddf'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:57.804200 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2032bb445a54d159a4a610cf9f5bddf'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:57.804852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2032bb445a54d159a4a610cf9f5bddf'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:57.871792 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2032bb445a54d159a4a610cf9f5bddf'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:57.878114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1358/2729] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:26:57 2021] DELETE /identity/v3/users/f2032bb445a54d159a4a610cf9f5bddf => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:57.882541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e55bd-2ddc-4026-826e-4e96c90ba23c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:57.883009 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e55bd-2ddc-4026-826e-4e96c90ba23c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:57.883109 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226e55bd-2ddc-4026-826e-4e96c90ba23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:57.901042 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-226e55bd-2ddc-4026-826e-4e96c90ba23c None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:57.902251 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-226e55bd-2ddc-4026-826e-4e96c90ba23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:57.957545 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1372/2730] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:57 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:57.967321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:57.968769 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:58.024663 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba20f69-1e1a-4123-b40d-1e1ad54594bf admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:58.028354 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353113a8-76c6-44e2-b1cc-7d351bdf3f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:58.028995 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353113a8-76c6-44e2-b1cc-7d351bdf3f93 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:58.029273 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353113a8-76c6-44e2-b1cc-7d351bdf3f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:58.029549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353113a8-76c6-44e2-b1cc-7d351bdf3f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:58.038468 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353113a8-76c6-44e2-b1cc-7d351bdf3f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:58.039820 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353113a8-76c6-44e2-b1cc-7d351bdf3f93 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:58.049615 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1359/2731] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:57 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:26:58.769938 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e55bd-2ddc-4026-826e-4e96c90ba23c None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:58.771369 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-226e55bd-2ddc-4026-826e-4e96c90ba23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:58.783757 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226e55bd-2ddc-4026-826e-4e96c90ba23c None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:58.790407 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:58.791266 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:58.791544 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:58.791813 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] PATH_INFO: `/v3/projects/68865d62b9a74ad19f284c6b3c916eb3` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:58.793630 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68865d62b9a74ad19f284c6b3c916eb3)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:58.795454 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:58.962383 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68865d62b9a74ad19f284c6b3c916eb3', 'request_id': 'req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:58.968515 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68865d62b9a74ad19f284c6b3c916eb3', 'request_id': 'req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:58.974969 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68865d62b9a74ad19f284c6b3c916eb3', 'request_id': 'req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:59.065163 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] The token cache is being invalidate because project 68865d62b9a74ad19f284c6b3c916eb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:26:59.065644 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:59.066247 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e1025540-0cda-4ce5-a2cc-c690f87e7dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:26:59.068093 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1373/2732] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:26:58 2021] DELETE /identity/v3/projects/68865d62b9a74ad19f284c6b3c916eb3 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:59.074052 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edefed-7528-46ea-9ed9-dcd3c8fafd34 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.074641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edefed-7528-46ea-9ed9-dcd3c8fafd34 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.074641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81edefed-7528-46ea-9ed9-dcd3c8fafd34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.094498 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-81edefed-7528-46ea-9ed9-dcd3c8fafd34 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:59.095794 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-81edefed-7528-46ea-9ed9-dcd3c8fafd34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:59.157101 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1360/2733] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:59.165864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e429522-8a1e-43a1-a12d-e791d2199593 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.166269 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e429522-8a1e-43a1-a12d-e791d2199593 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.166753 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e429522-8a1e-43a1-a12d-e791d2199593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.185855 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-3e429522-8a1e-43a1-a12d-e791d2199593 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:59.187187 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-3e429522-8a1e-43a1-a12d-e791d2199593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:59.195217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1374/2734] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:59 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:59.199493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edefed-7528-46ea-9ed9-dcd3c8fafd34 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:59.208920 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81edefed-7528-46ea-9ed9-dcd3c8fafd34 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:59.213721 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0f6c9-63f4-480d-8fd9-e59166793592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:59.215096 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0f6c9-63f4-480d-8fd9-e59166793592 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.215260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0f6c9-63f4-480d-8fd9-e59166793592 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.215537 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c0f6c9-63f4-480d-8fd9-e59166793592 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.216271 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0f6c9-63f4-480d-8fd9-e59166793592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:26:59.217069 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0f6c9-63f4-480d-8fd9-e59166793592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:59.218178 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c0f6c9-63f4-480d-8fd9-e59166793592 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:59.230711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1361/2735] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:26:59 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 27 01:26:59.235008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e429522-8a1e-43a1-a12d-e791d2199593 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:59.244387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e429522-8a1e-43a1-a12d-e791d2199593 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:59.249365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0cfb8-c77e-493a-b940-1a4561d6dafe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:59.250089 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0cfb8-c77e-493a-b940-1a4561d6dafe admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.255627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0cfb8-c77e-493a-b940-1a4561d6dafe admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.255627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0cfb8-c77e-493a-b940-1a4561d6dafe admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.255627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0cfb8-c77e-493a-b940-1a4561d6dafe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:59.255627 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0cfb8-c77e-493a-b940-1a4561d6dafe admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:59.357654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1375/2736] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:26:59 2021] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:26:59.361729 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0f6c9-63f4-480d-8fd9-e59166793592 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:59.371551 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c0f6c9-63f4-480d-8fd9-e59166793592 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:59.427953 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d8c2-806a-45d1-afd9-36f520127836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:59.428618 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d8c2-806a-45d1-afd9-36f520127836 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.428899 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d8c2-806a-45d1-afd9-36f520127836 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.429174 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824d8c2-806a-45d1-afd9-36f520127836 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.429895 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d8c2-806a-45d1-afd9-36f520127836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:59.431809 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824d8c2-806a-45d1-afd9-36f520127836 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:59.543567 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1362/2737] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:26:59 2021] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:26:59.547905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0cfb8-c77e-493a-b940-1a4561d6dafe admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:59.558297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0cfb8-c77e-493a-b940-1a4561d6dafe admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:59.563061 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244fca3-1212-407d-b4dd-e7640b7daeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:59.563706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244fca3-1212-407d-b4dd-e7640b7daeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.564570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244fca3-1212-407d-b4dd-e7640b7daeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.564570 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8244fca3-1212-407d-b4dd-e7640b7daeb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.564953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244fca3-1212-407d-b4dd-e7640b7daeb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:59.566656 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8244fca3-1212-407d-b4dd-e7640b7daeb4 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:59.578311 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1376/2738] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 27 01:26:59.582418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d8c2-806a-45d1-afd9-36f520127836 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:59.593654 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824d8c2-806a-45d1-afd9-36f520127836 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:59.598368 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef744ff-a8e1-4b0c-8db5-8077075375fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:59.599296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef744ff-a8e1-4b0c-8db5-8077075375fa admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.599581 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef744ff-a8e1-4b0c-8db5-8077075375fa admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.599983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef744ff-a8e1-4b0c-8db5-8077075375fa admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.600722 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef744ff-a8e1-4b0c-8db5-8077075375fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:59.602314 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef744ff-a8e1-4b0c-8db5-8077075375fa admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:59.616312 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1363/2739] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:26:59 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:26:59.617604 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244fca3-1212-407d-b4dd-e7640b7daeb4 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:59.627579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8244fca3-1212-407d-b4dd-e7640b7daeb4 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:59.632309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb2019-7a58-4df2-ae6a-2270ec875c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:59.633308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb2019-7a58-4df2-ae6a-2270ec875c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.633654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb2019-7a58-4df2-ae6a-2270ec875c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.633930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb2019-7a58-4df2-ae6a-2270ec875c1e admin admin] PATH_INFO: `/v3/projects/6573643a84624d379edd5bdaba93af41/users/fb12a5c2f19e4766b94982f358d542f7/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.648305 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb2019-7a58-4df2-ae6a-2270ec875c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6573643a84624d379edd5bdaba93af41, user_id=fb12a5c2f19e4766b94982f358d542f7, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:59.651022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb2019-7a58-4df2-ae6a-2270ec875c1e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:59.731931 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1377/2740] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:26:59 2021] PUT /identity/v3/projects/6573643a84624d379edd5bdaba93af41/users/fb12a5c2f19e4766b94982f358d542f7/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:26:59.742286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b905a0-299a-48f2-b8f6-84711ea50643 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.742571 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b905a0-299a-48f2-b8f6-84711ea50643 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.742843 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b905a0-299a-48f2-b8f6-84711ea50643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.770114 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-71b905a0-299a-48f2-b8f6-84711ea50643 None None] MFA Rules not processed for user `fb12a5c2f19e4766b94982f358d542f7`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:26:59.771225 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-71b905a0-299a-48f2-b8f6-84711ea50643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:59.837604 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1364/2741] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:26:59 2021] POST /identity/v3/auth/tokens => generated 3405 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:26:59.847930 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb2019-7a58-4df2-ae6a-2270ec875c1e admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:26:59.849894 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-9feb2019-7a58-4df2-ae6a-2270ec875c1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:26:59.907070 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb2019-7a58-4df2-ae6a-2270ec875c1e admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:26:59.910739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f46f7-852d-4e6d-8ff1-e8864732c58d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:26:59.911374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f46f7-852d-4e6d-8ff1-e8864732c58d service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:26:59.911654 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f46f7-852d-4e6d-8ff1-e8864732c58d service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:26:59.911921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f46f7-852d-4e6d-8ff1-e8864732c58d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:26:59.921848 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f46f7-852d-4e6d-8ff1-e8864732c58d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:26:59.923308 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f46f7-852d-4e6d-8ff1-e8864732c58d service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:26:59.931864 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1378/2742] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:26:59 2021] GET /identity/v3/auth/tokens => generated 3405 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:09.993222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b905a0-299a-48f2-b8f6-84711ea50643 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:10.053090 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b905a0-299a-48f2-b8f6-84711ea50643 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:10.058447 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:10.059301 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:10.059572 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:10.059839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] PATH_INFO: `/v3/users/fb12a5c2f19e4766b94982f358d542f7` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:10.061016 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb12a5c2f19e4766b94982f358d542f7)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:10.062926 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:10.252719 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb12a5c2f19e4766b94982f358d542f7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:10.264212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb12a5c2f19e4766b94982f358d542f7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:10.270610 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb12a5c2f19e4766b94982f358d542f7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:10.271283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb12a5c2f19e4766b94982f358d542f7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:10.337257 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb12a5c2f19e4766b94982f358d542f7'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:10.346073 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1365/2743] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:27:09 2021] DELETE /identity/v3/users/fb12a5c2f19e4766b94982f358d542f7 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:27:10.351473 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326508-dd33-4e8b-a84f-3ab207b29387 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:10.352150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326508-dd33-4e8b-a84f-3ab207b29387 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:10.352453 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68326508-dd33-4e8b-a84f-3ab207b29387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:10.372787 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-68326508-dd33-4e8b-a84f-3ab207b29387 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:10.376345 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-68326508-dd33-4e8b-a84f-3ab207b29387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:10.430833 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1379/2744] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:10 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:10.440768 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:10.442183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:10.498367 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c713e8d0-70c8-4cb1-9be6-91f3d8b68d2c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:10.501976 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab11406-c967-4368-9ee2-fdc0c05db9e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:10.502641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab11406-c967-4368-9ee2-fdc0c05db9e3 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:10.502975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab11406-c967-4368-9ee2-fdc0c05db9e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:10.503193 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab11406-c967-4368-9ee2-fdc0c05db9e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:10.512879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab11406-c967-4368-9ee2-fdc0c05db9e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:10.514315 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab11406-c967-4368-9ee2-fdc0c05db9e3 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:10.523424 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1366/2745] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:10 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:10.929929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326508-dd33-4e8b-a84f-3ab207b29387 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:10.931384 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-68326508-dd33-4e8b-a84f-3ab207b29387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:10.943868 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68326508-dd33-4e8b-a84f-3ab207b29387 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:10.948314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:10.949164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:10.949457 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:10.949726 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] PATH_INFO: `/v3/projects/6573643a84624d379edd5bdaba93af41` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:10.950946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6573643a84624d379edd5bdaba93af41)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:10.952845 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:11.064867 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6573643a84624d379edd5bdaba93af41', 'request_id': 'req-e669887b-b965-4e39-9a43-3df7ad93451b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:11.070743 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6573643a84624d379edd5bdaba93af41', 'request_id': 'req-e669887b-b965-4e39-9a43-3df7ad93451b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:11.075952 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6573643a84624d379edd5bdaba93af41', 'request_id': 'req-e669887b-b965-4e39-9a43-3df7ad93451b'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:11.162638 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] The token cache is being invalidate because project 6573643a84624d379edd5bdaba93af41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:27:11.162925 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:11.163788 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-e669887b-b965-4e39-9a43-3df7ad93451b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:11.165623 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1380/2746] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:27:10 2021] DELETE /identity/v3/projects/6573643a84624d379edd5bdaba93af41 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:27:11.173183 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8a3b0-0e48-4acf-949d-18574f783359 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.173778 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8a3b0-0e48-4acf-949d-18574f783359 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.173879 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a8a3b0-0e48-4acf-949d-18574f783359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.191593 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-10a8a3b0-0e48-4acf-949d-18574f783359 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:11.194989 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-10a8a3b0-0e48-4acf-949d-18574f783359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:11.250629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1367/2747] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:11.258825 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e0df9-ffb1-4163-8537-6b8c5a27a2fa None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.259115 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e0df9-ffb1-4163-8537-6b8c5a27a2fa None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.259394 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e0df9-ffb1-4163-8537-6b8c5a27a2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.278953 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-618e0df9-ffb1-4163-8537-6b8c5a27a2fa None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:11.280175 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-618e0df9-ffb1-4163-8537-6b8c5a27a2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:11.287935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1381/2748] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:11 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:11.295232 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8a3b0-0e48-4acf-949d-18574f783359 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:11.304647 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a8a3b0-0e48-4acf-949d-18574f783359 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:11.309732 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153a05d-f3d3-48c3-bd7d-8fb0d998132a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:11.310406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153a05d-f3d3-48c3-bd7d-8fb0d998132a admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.310684 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153a05d-f3d3-48c3-bd7d-8fb0d998132a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.310955 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153a05d-f3d3-48c3-bd7d-8fb0d998132a admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.311681 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153a05d-f3d3-48c3-bd7d-8fb0d998132a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:27:11.311982 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153a05d-f3d3-48c3-bd7d-8fb0d998132a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:11.313549 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153a05d-f3d3-48c3-bd7d-8fb0d998132a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:11.327509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1368/2749] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:27:11 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:27:11.330780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e0df9-ffb1-4163-8537-6b8c5a27a2fa None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:11.340157 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e0df9-ffb1-4163-8537-6b8c5a27a2fa None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:11.344851 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74411b24-9cf6-4089-b5d5-f2b63940e171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:11.345490 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74411b24-9cf6-4089-b5d5-f2b63940e171 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.345770 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74411b24-9cf6-4089-b5d5-f2b63940e171 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.346077 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74411b24-9cf6-4089-b5d5-f2b63940e171 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.346772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74411b24-9cf6-4089-b5d5-f2b63940e171 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:11.348913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74411b24-9cf6-4089-b5d5-f2b63940e171 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:11.466684 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1382/2750] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:27:11 2021] POST /identity/v3/projects => generated 361 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:27:11.470727 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153a05d-f3d3-48c3-bd7d-8fb0d998132a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:11.481555 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153a05d-f3d3-48c3-bd7d-8fb0d998132a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:11.534932 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4a4c-404e-4345-be72-44371c50c328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:11.535594 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4a4c-404e-4345-be72-44371c50c328 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.535896 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4a4c-404e-4345-be72-44371c50c328 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.536168 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0c4a4c-404e-4345-be72-44371c50c328 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.536869 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c4a4c-404e-4345-be72-44371c50c328 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:11.538790 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0c4a4c-404e-4345-be72-44371c50c328 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:11.643165 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1369/2751] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:27:11 2021] POST /identity/v3/users => generated 281 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:27:11.647286 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74411b24-9cf6-4089-b5d5-f2b63940e171 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:11.658401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74411b24-9cf6-4089-b5d5-f2b63940e171 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:11.663019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638fe6-4007-4759-bb66-bef825639d59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:11.663739 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638fe6-4007-4759-bb66-bef825639d59 admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.664014 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638fe6-4007-4759-bb66-bef825639d59 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.664280 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0638fe6-4007-4759-bb66-bef825639d59 admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.665030 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0638fe6-4007-4759-bb66-bef825639d59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:11.666635 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0638fe6-4007-4759-bb66-bef825639d59 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:11.676760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1383/2752] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:27:11 2021] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:27:11.680509 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4a4c-404e-4345-be72-44371c50c328 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:11.690278 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0c4a4c-404e-4345-be72-44371c50c328 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:11.694839 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ee2dfb-4ef3-40a4-9e86-abd62d5081a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:11.695483 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee2dfb-4ef3-40a4-9e86-abd62d5081a1 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.695767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee2dfb-4ef3-40a4-9e86-abd62d5081a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.696039 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ee2dfb-4ef3-40a4-9e86-abd62d5081a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.696766 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee2dfb-4ef3-40a4-9e86-abd62d5081a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:11.698924 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ee2dfb-4ef3-40a4-9e86-abd62d5081a1 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:11.708481 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1370/2753] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:27:11 2021] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:27:11.712547 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638fe6-4007-4759-bb66-bef825639d59 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:11.723502 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0638fe6-4007-4759-bb66-bef825639d59 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:11.728164 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400b32a-5003-4f3c-8c9c-637a125b42c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:11.729022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400b32a-5003-4f3c-8c9c-637a125b42c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.729330 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400b32a-5003-4f3c-8c9c-637a125b42c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.729837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b400b32a-5003-4f3c-8c9c-637a125b42c7 admin admin] PATH_INFO: `/v3/projects/fc9009161a974b33a10fd6d9d942a580/users/6a7ff19e40b34a459a9d5a93d94436cc/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.743720 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400b32a-5003-4f3c-8c9c-637a125b42c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc9009161a974b33a10fd6d9d942a580, user_id=6a7ff19e40b34a459a9d5a93d94436cc, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:11.746662 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b400b32a-5003-4f3c-8c9c-637a125b42c7 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:11.812500 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1384/2754] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:27:11 2021] PUT /identity/v3/projects/fc9009161a974b33a10fd6d9d942a580/users/6a7ff19e40b34a459a9d5a93d94436cc/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:27:11.823975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221a07-7b83-4e1c-8a3a-dad830924b5c None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:11.824258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221a07-7b83-4e1c-8a3a-dad830924b5c None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:11.824529 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e221a07-7b83-4e1c-8a3a-dad830924b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:11.850699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-4e221a07-7b83-4e1c-8a3a-dad830924b5c None None] MFA Rules not processed for user `6a7ff19e40b34a459a9d5a93d94436cc`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:11.851885 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-4e221a07-7b83-4e1c-8a3a-dad830924b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:11.911754 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1371/2755] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:11 2021] POST /identity/v3/auth/tokens => generated 3381 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:11.939671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400b32a-5003-4f3c-8c9c-637a125b42c7 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:11.941348 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-b400b32a-5003-4f3c-8c9c-637a125b42c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:11.999889 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b400b32a-5003-4f3c-8c9c-637a125b42c7 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:12.003581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f536a08-ac4c-4b26-80ce-360e4fb9cd68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:12.004220 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f536a08-ac4c-4b26-80ce-360e4fb9cd68 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:12.004504 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f536a08-ac4c-4b26-80ce-360e4fb9cd68 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:12.004780 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f536a08-ac4c-4b26-80ce-360e4fb9cd68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:12.013208 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f536a08-ac4c-4b26-80ce-360e4fb9cd68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:12.014672 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f536a08-ac4c-4b26-80ce-360e4fb9cd68 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:12.023297 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1385/2756] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:11 2021] GET /identity/v3/auth/tokens => generated 3381 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:12.037518 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e221a07-7b83-4e1c-8a3a-dad830924b5c None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:12.097022 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e221a07-7b83-4e1c-8a3a-dad830924b5c None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:12.101889 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:12.102765 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:12.103046 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:12.103320 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] PATH_INFO: `/v3/users/6a7ff19e40b34a459a9d5a93d94436cc` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:12.105138 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7ff19e40b34a459a9d5a93d94436cc)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:12.107057 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:12.278969 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7ff19e40b34a459a9d5a93d94436cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:12.290089 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7ff19e40b34a459a9d5a93d94436cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:12.296564 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7ff19e40b34a459a9d5a93d94436cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:12.297276 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7ff19e40b34a459a9d5a93d94436cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:12.413253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7ff19e40b34a459a9d5a93d94436cc'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:12.419691 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1372/2757] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:27:12 2021] DELETE /identity/v3/users/6a7ff19e40b34a459a9d5a93d94436cc => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:27:12.424287 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798777f1-56cf-4cca-8fb6-0b01399dc3a2 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:12.424596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798777f1-56cf-4cca-8fb6-0b01399dc3a2 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:12.424898 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798777f1-56cf-4cca-8fb6-0b01399dc3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:12.443003 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-798777f1-56cf-4cca-8fb6-0b01399dc3a2 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:12.444225 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-798777f1-56cf-4cca-8fb6-0b01399dc3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:12.502474 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1386/2758] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:12 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:12.513261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:12.514673 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:12.571137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee9758f-b2bd-49a6-a3b4-d264f2b2ab9a admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:12.575102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970650c-09ef-4af4-8de0-3a4f80213052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:12.575738 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970650c-09ef-4af4-8de0-3a4f80213052 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:12.576010 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970650c-09ef-4af4-8de0-3a4f80213052 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:12.576275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970650c-09ef-4af4-8de0-3a4f80213052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:12.584872 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970650c-09ef-4af4-8de0-3a4f80213052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:12.586296 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970650c-09ef-4af4-8de0-3a4f80213052 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:12.595867 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1373/2759] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:12 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:13.013629 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798777f1-56cf-4cca-8fb6-0b01399dc3a2 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:13.015054 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-798777f1-56cf-4cca-8fb6-0b01399dc3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:13.027585 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798777f1-56cf-4cca-8fb6-0b01399dc3a2 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:13.033475 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:13.034374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.034657 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.034968 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] PATH_INFO: `/v3/projects/fc9009161a974b33a10fd6d9d942a580` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.036210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc9009161a974b33a10fd6d9d942a580)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:13.038162 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:13.185870 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc9009161a974b33a10fd6d9d942a580', 'request_id': 'req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:13.191862 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc9009161a974b33a10fd6d9d942a580', 'request_id': 'req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:13.197056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc9009161a974b33a10fd6d9d942a580', 'request_id': 'req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:13.298683 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] The token cache is being invalidate because project fc9009161a974b33a10fd6d9d942a580 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:27:13.298966 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:13.299560 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-dae630b6-55e5-4bc1-9a76-bb6d5467fd7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:27:13.301065 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1387/2760] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:27:13 2021] DELETE /identity/v3/projects/fc9009161a974b33a10fd6d9d942a580 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:27:13.306709 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5d64-88a2-480e-92ea-b95c68603e2e None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.307755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5d64-88a2-480e-92ea-b95c68603e2e None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.307861 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aea5d64-88a2-480e-92ea-b95c68603e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.326102 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1aea5d64-88a2-480e-92ea-b95c68603e2e None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:13.327282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1aea5d64-88a2-480e-92ea-b95c68603e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:13.383316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1374/2761] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:13.392032 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b082-2006-48c7-a517-5902f3ac4dcf None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.392317 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b082-2006-48c7-a517-5902f3ac4dcf None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.392591 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5b082-2006-48c7-a517-5902f3ac4dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.410758 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-f7f5b082-2006-48c7-a517-5902f3ac4dcf None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:13.411939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-f7f5b082-2006-48c7-a517-5902f3ac4dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:13.419792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1388/2762] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:13.423956 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5d64-88a2-480e-92ea-b95c68603e2e None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:13.433711 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aea5d64-88a2-480e-92ea-b95c68603e2e None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:13.438541 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6855bf9-e5f1-47a5-8914-54a3eb94961c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:13.439137 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6855bf9-e5f1-47a5-8914-54a3eb94961c admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.439442 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6855bf9-e5f1-47a5-8914-54a3eb94961c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.439748 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6855bf9-e5f1-47a5-8914-54a3eb94961c admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.440511 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6855bf9-e5f1-47a5-8914-54a3eb94961c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:27:13.440840 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6855bf9-e5f1-47a5-8914-54a3eb94961c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:13.442620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6855bf9-e5f1-47a5-8914-54a3eb94961c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:13.456106 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1375/2763] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:27:13 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:27:13.461367 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5b082-2006-48c7-a517-5902f3ac4dcf None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:13.472102 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5b082-2006-48c7-a517-5902f3ac4dcf None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:13.476905 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a854-e2a5-4f00-afee-babcc3467c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:13.477555 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a854-e2a5-4f00-afee-babcc3467c34 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.477830 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a854-e2a5-4f00-afee-babcc3467c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.478133 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d5a854-e2a5-4f00-afee-babcc3467c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.478838 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5a854-e2a5-4f00-afee-babcc3467c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:13.480992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d5a854-e2a5-4f00-afee-babcc3467c34 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:13.567174 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1389/2764] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:27:13 2021] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:27:13.569222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6855bf9-e5f1-47a5-8914-54a3eb94961c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:13.579700 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6855bf9-e5f1-47a5-8914-54a3eb94961c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:13.633264 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c012aa7-137b-496a-8963-ce8a79a34adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:13.633916 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c012aa7-137b-496a-8963-ce8a79a34adc admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.634227 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c012aa7-137b-496a-8963-ce8a79a34adc admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.634496 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c012aa7-137b-496a-8963-ce8a79a34adc admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.635185 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c012aa7-137b-496a-8963-ce8a79a34adc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:13.637620 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c012aa7-137b-496a-8963-ce8a79a34adc admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:13.719406 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1376/2765] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:27:13 2021] POST /identity/v3/users => generated 287 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:27:13.723661 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a854-e2a5-4f00-afee-babcc3467c34 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:13.734871 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d5a854-e2a5-4f00-afee-babcc3467c34 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:13.739609 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04771e9-5d26-44ca-8afb-e939112140fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:13.740284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04771e9-5d26-44ca-8afb-e939112140fc admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.740557 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04771e9-5d26-44ca-8afb-e939112140fc admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.740825 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04771e9-5d26-44ca-8afb-e939112140fc admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.741601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04771e9-5d26-44ca-8afb-e939112140fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:13.743294 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04771e9-5d26-44ca-8afb-e939112140fc admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:13.755990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1390/2766] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:27:13 2021] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:27:13.759818 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c012aa7-137b-496a-8963-ce8a79a34adc admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:13.769821 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c012aa7-137b-496a-8963-ce8a79a34adc admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:13.774576 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647134e1-8eea-4e1b-a857-a7b2c35ae5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:13.775230 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647134e1-8eea-4e1b-a857-a7b2c35ae5a9 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.775507 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647134e1-8eea-4e1b-a857-a7b2c35ae5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.775777 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647134e1-8eea-4e1b-a857-a7b2c35ae5a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.776659 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647134e1-8eea-4e1b-a857-a7b2c35ae5a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:13.778241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647134e1-8eea-4e1b-a857-a7b2c35ae5a9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:13.787934 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1377/2767] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:27:13 2021] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:27:13.792485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04771e9-5d26-44ca-8afb-e939112140fc admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:13.801997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04771e9-5d26-44ca-8afb-e939112140fc admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:13.806523 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad151b12-f393-4991-a0e3-391d682d7372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:13.808020 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad151b12-f393-4991-a0e3-391d682d7372 admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.808407 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad151b12-f393-4991-a0e3-391d682d7372 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.808680 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad151b12-f393-4991-a0e3-391d682d7372 admin admin] PATH_INFO: `/v3/projects/ca625749d153471ea9f389ce0cb40803/users/1df7faf4f8de4ae3b22a0b393dd970df/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.822352 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad151b12-f393-4991-a0e3-391d682d7372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca625749d153471ea9f389ce0cb40803, user_id=1df7faf4f8de4ae3b22a0b393dd970df, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:13.825219 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad151b12-f393-4991-a0e3-391d682d7372 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:13.928264 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1391/2768] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:27:13 2021] PUT /identity/v3/projects/ca625749d153471ea9f389ce0cb40803/users/1df7faf4f8de4ae3b22a0b393dd970df/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:27:13.934344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28486-1e4b-4364-a07e-21411fc24cfc None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:13.934634 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28486-1e4b-4364-a07e-21411fc24cfc None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:13.934906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b28486-1e4b-4364-a07e-21411fc24cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:13.954556 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-c0b28486-1e4b-4364-a07e-21411fc24cfc None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:13.955742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-c0b28486-1e4b-4364-a07e-21411fc24cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:14.013557 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1378/2769] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:13 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:14.023190 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad151b12-f393-4991-a0e3-391d682d7372 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:14.024900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-ad151b12-f393-4991-a0e3-391d682d7372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:14.078450 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad151b12-f393-4991-a0e3-391d682d7372 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:14.081990 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cfdc1-4d28-48f2-bdf5-787dad1bb749 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:14.082646 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cfdc1-4d28-48f2-bdf5-787dad1bb749 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:14.082921 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cfdc1-4d28-48f2-bdf5-787dad1bb749 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:14.083192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501cfdc1-4d28-48f2-bdf5-787dad1bb749 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:14.092677 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cfdc1-4d28-48f2-bdf5-787dad1bb749 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:14.094118 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501cfdc1-4d28-48f2-bdf5-787dad1bb749 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:14.103672 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1392/2770] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:14 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:15.446651 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f23581-b7be-4df3-af48-76845efd1d33 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:15.447120 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f23581-b7be-4df3-af48-76845efd1d33 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:15.447218 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f23581-b7be-4df3-af48-76845efd1d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:15.473601 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-b9f23581-b7be-4df3-af48-76845efd1d33 None None] MFA Rules not processed for user `1df7faf4f8de4ae3b22a0b393dd970df`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:15.474831 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b9f23581-b7be-4df3-af48-76845efd1d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:15.539849 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1379/2771] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:15 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:15.550085 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cfdc1-4d28-48f2-bdf5-787dad1bb749 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:15.551451 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-501cfdc1-4d28-48f2-bdf5-787dad1bb749 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:15.610946 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501cfdc1-4d28-48f2-bdf5-787dad1bb749 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:15.614484 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758760e0-1a1d-4928-9906-dca8fcdff952 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:15.615123 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758760e0-1a1d-4928-9906-dca8fcdff952 service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:15.615398 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758760e0-1a1d-4928-9906-dca8fcdff952 service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:15.615703 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758760e0-1a1d-4928-9906-dca8fcdff952 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:15.624496 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758760e0-1a1d-4928-9906-dca8fcdff952 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:15.625964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758760e0-1a1d-4928-9906-dca8fcdff952 service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:15.634596 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1393/2772] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:15 2021] GET /identity/v3/auth/tokens => generated 3393 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:17.360321 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32f352-6c8e-4560-89a8-bf0c0e0253b4 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:17.360832 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32f352-6c8e-4560-89a8-bf0c0e0253b4 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:17.360930 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32f352-6c8e-4560-89a8-bf0c0e0253b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:17.381103 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-da32f352-6c8e-4560-89a8-bf0c0e0253b4 None None] MFA Rules not processed for user `1df7faf4f8de4ae3b22a0b393dd970df`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:17.382323 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-da32f352-6c8e-4560-89a8-bf0c0e0253b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:17.389947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1380/2773] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:17 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:27:30.504442 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758760e0-1a1d-4928-9906-dca8fcdff952 service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:27:30.505913 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-758760e0-1a1d-4928-9906-dca8fcdff952 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:30.574997 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758760e0-1a1d-4928-9906-dca8fcdff952 service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:27:30.579865 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8becd633-654f-4174-a28c-0cc78e7f9175 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8df6e02fde834883aef230f31d6ecd94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:27:30.580503 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becd633-654f-4174-a28c-0cc78e7f9175 service placement] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:30.580778 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becd633-654f-4174-a28c-0cc78e7f9175 service placement] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:30.581047 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8becd633-654f-4174-a28c-0cc78e7f9175 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:30.582807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8becd633-654f-4174-a28c-0cc78e7f9175 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:30.594511 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becd633-654f-4174-a28c-0cc78e7f9175 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:27:30.596073 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8becd633-654f-4174-a28c-0cc78e7f9175 service placement] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:27:30.606331 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1394/2774] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:27:30 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:27:37.742520 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0abf-01ee-4481-ae7b-bdd9bac3efbb None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:27:37.743031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0abf-01ee-4481-ae7b-bdd9bac3efbb None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:27:37.743143 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0abf-01ee-4481-ae7b-bdd9bac3efbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:27:37.760739 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-dd1d0abf-01ee-4481-ae7b-bdd9bac3efbb None None] MFA Rules not processed for user `1df7faf4f8de4ae3b22a0b393dd970df`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:27:37.761920 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dd1d0abf-01ee-4481-ae7b-bdd9bac3efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:27:37.768713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1381/2775] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:27:37 2021] POST /identity/v3/auth/tokens => generated 3393 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:09.208708 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0b676-bd73-439b-b559-626cca197e4c None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:09.209209 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0b676-bd73-439b-b559-626cca197e4c None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:09.209322 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0b676-bd73-439b-b559-626cca197e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:09.226380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-2be0b676-bd73-439b-b559-626cca197e4c None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:09.227541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-2be0b676-bd73-439b-b559-626cca197e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:09.282401 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1395/2776] 10.222.0.32 () {58 vars in 1009 bytes} [Wed Oct 27 01:28:09 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:09.442289 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0abf-01ee-4481-ae7b-bdd9bac3efbb None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:09.443736 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-dd1d0abf-01ee-4481-ae7b-bdd9bac3efbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:09.519519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0abf-01ee-4481-ae7b-bdd9bac3efbb None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:09.525344 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6311ed-a254-4a99-92b3-5afd2ffa08af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:09.526019 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6311ed-a254-4a99-92b3-5afd2ffa08af service swift] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:09.526399 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6311ed-a254-4a99-92b3-5afd2ffa08af service swift] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:09.526695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6311ed-a254-4a99-92b3-5afd2ffa08af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:09.535562 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6311ed-a254-4a99-92b3-5afd2ffa08af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:09.537064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6311ed-a254-4a99-92b3-5afd2ffa08af service swift] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:09.545755 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1382/2777] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:28:09 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:28:13.879393 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e206f-ae43-4ef7-8f05-672f48d15220 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:13.879818 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e206f-ae43-4ef7-8f05-672f48d15220 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:13.879923 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e206f-ae43-4ef7-8f05-672f48d15220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:13.900252 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-005e206f-ae43-4ef7-8f05-672f48d15220 None None] MFA Rules not processed for user `a6fb31f457cb4c268d6f4e06bf5ee703`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:13.901792 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-005e206f-ae43-4ef7-8f05-672f48d15220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:13.957919 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1396/2778] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:28:13 2021] POST /identity/v3/auth/tokens => generated 3403 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:28:28.220362 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a8e86-7957-415a-9609-23569d5b64ac None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:28.220813 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a8e86-7957-415a-9609-23569d5b64ac None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:28.221535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a8e86-7957-415a-9609-23569d5b64ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:28.239124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-939a8e86-7957-415a-9609-23569d5b64ac None None] MFA Rules not processed for user `0a7c06728e9b49b68a4ea132f467c603`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:28.240300 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-939a8e86-7957-415a-9609-23569d5b64ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:28.248335 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1383/2779] 10.222.0.32 () {58 vars in 967 bytes} [Wed Oct 27 01:28:28 2021] POST /identity/v3/auth/tokens => generated 3338 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:28:28.261271 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e206f-ae43-4ef7-8f05-672f48d15220 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:28.273364 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e206f-ae43-4ef7-8f05-672f48d15220 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:28.279885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cf0c4-c24a-4e67-bce9-3b6ca4d27e8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3856a21179234c9ebcbd4a9bd7ee3945', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:28.280615 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cf0c4-c24a-4e67-bce9-3b6ca4d27e8e service swift] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:28.280964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cf0c4-c24a-4e67-bce9-3b6ca4d27e8e service swift] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:28.281314 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168cf0c4-c24a-4e67-bce9-3b6ca4d27e8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:28.290056 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cf0c4-c24a-4e67-bce9-3b6ca4d27e8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:28.291931 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168cf0c4-c24a-4e67-bce9-3b6ca4d27e8e service swift] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:28.300760 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1397/2780] 10.222.0.32 () {60 vars in 1384 bytes} [Wed Oct 27 01:28:28 2021] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 27 01:28:31.405268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a8e86-7957-415a-9609-23569d5b64ac None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:31.418290 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a8e86-7957-415a-9609-23569d5b64ac None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:31.423373 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:31.424105 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:31.424452 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:31.424643 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] PATH_INFO: `/v3/users/1df7faf4f8de4ae3b22a0b393dd970df` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:31.425842 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1df7faf4f8de4ae3b22a0b393dd970df)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:31.428503 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:31.605543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1df7faf4f8de4ae3b22a0b393dd970df'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:31.617391 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1df7faf4f8de4ae3b22a0b393dd970df'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:31.624082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1df7faf4f8de4ae3b22a0b393dd970df'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:31.624706 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1df7faf4f8de4ae3b22a0b393dd970df'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:31.703380 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-4b80d61b-842a-40ff-bece-a10ac8a7a48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1df7faf4f8de4ae3b22a0b393dd970df'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:31.709680 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1384/2781] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:28:31 2021] DELETE /identity/v3/users/1df7faf4f8de4ae3b22a0b393dd970df => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:28:31.986973 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cf0c4-c24a-4e67-bce9-3b6ca4d27e8e service swift] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:28:32.002489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168cf0c4-c24a-4e67-bce9-3b6ca4d27e8e service swift] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:28:32.055534 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:28:32.056388 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:32.057409 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:32.057728 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] PATH_INFO: `/v3/projects/ca625749d153471ea9f389ce0cb40803` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:32.058947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca625749d153471ea9f389ce0cb40803)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:28:32.060837 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:28:32.159489 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca625749d153471ea9f389ce0cb40803', 'request_id': 'req-d2e852a9-0849-4805-b562-9baa380d11b2'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:32.165328 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca625749d153471ea9f389ce0cb40803', 'request_id': 'req-d2e852a9-0849-4805-b562-9baa380d11b2'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:32.170671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca625749d153471ea9f389ce0cb40803', 'request_id': 'req-d2e852a9-0849-4805-b562-9baa380d11b2'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:32.253112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] The token cache is being invalidate because project ca625749d153471ea9f389ce0cb40803 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:28:32.253327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:32.253939 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:28:32.255579 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1398/2782] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:28:31 2021] DELETE /identity/v3/projects/ca625749d153471ea9f389ce0cb40803 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:28:48.438570 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fd63-368b-41a2-8d0e-2f026df70d49 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:28:48.439070 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fd63-368b-41a2-8d0e-2f026df70d49 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:28:48.439164 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225fd63-368b-41a2-8d0e-2f026df70d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:28:48.457150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-1225fd63-368b-41a2-8d0e-2f026df70d49 None None] MFA Rules not processed for user `eb7fe651d1c84f28a9267a543d0e2497`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:28:48.458392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-1225fd63-368b-41a2-8d0e-2f026df70d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:28:48.512947 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1385/2783] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:28:48 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:08.050002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:08.052327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:08.109419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e852a9-0849-4805-b562-9baa380d11b2 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:08.113671 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbc86b-ed7a-4dd3-9a21-2e3c372ceff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:08.115246 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbc86b-ed7a-4dd3-9a21-2e3c372ceff5 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:08.115533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbc86b-ed7a-4dd3-9a21-2e3c372ceff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:08.115812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbc86b-ed7a-4dd3-9a21-2e3c372ceff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:08.117588 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-60fbc86b-ed7a-4dd3-9a21-2e3c372ceff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:08.185232 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbc86b-ed7a-4dd3-9a21-2e3c372ceff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:08.186688 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbc86b-ed7a-4dd3-9a21-2e3c372ceff5 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:08.197337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1399/2784] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:29:08 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:09.360629 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fd63-368b-41a2-8d0e-2f026df70d49 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:09.370617 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225fd63-368b-41a2-8d0e-2f026df70d49 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:09.374074 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:09.374701 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:09.374975 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:09.375243 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:09.377199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:09.391878 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:09.393303 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:09.404250 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1386/2785] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:29:09 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:21.866241 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbc86b-ed7a-4dd3-9a21-2e3c372ceff5 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:21.877217 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbc86b-ed7a-4dd3-9a21-2e3c372ceff5 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:21.880807 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8011e-295c-47ca-8a85-98248ac32bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:21.881437 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8011e-295c-47ca-8a85-98248ac32bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:21.881710 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8011e-295c-47ca-8a85-98248ac32bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:21.881975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba8011e-295c-47ca-8a85-98248ac32bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:21.883772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-1ba8011e-295c-47ca-8a85-98248ac32bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:21.946549 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8011e-295c-47ca-8a85-98248ac32bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:21.948119 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba8011e-295c-47ca-8a85-98248ac32bc4 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:21.957374 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1400/2786] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:29:21 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:23.447439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:23.447439 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:23.458566 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fdfc2c-2dd2-4cf1-a9ae-64a1c63175a5 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:23.463292 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:23.464150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:23.464426 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:23.464697 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] PATH_INFO: `/v3/users/a6fb31f457cb4c268d6f4e06bf5ee703` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:23.465990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6fb31f457cb4c268d6f4e06bf5ee703)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:23.468124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:23.609961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6fb31f457cb4c268d6f4e06bf5ee703'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:23.626699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6fb31f457cb4c268d6f4e06bf5ee703'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:23.635386 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6fb31f457cb4c268d6f4e06bf5ee703'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:23.636125 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6fb31f457cb4c268d6f4e06bf5ee703'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:23.692429 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-a87c9f6a-f1cb-40b2-881f-163f5348cb1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6fb31f457cb4c268d6f4e06bf5ee703'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:23.700226 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1387/2787] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:29:23 2021] DELETE /identity/v3/users/a6fb31f457cb4c268d6f4e06bf5ee703 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:23.959857 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8011e-295c-47ca-8a85-98248ac32bc4 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:23.972112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba8011e-295c-47ca-8a85-98248ac32bc4 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:24.045687 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:24.046601 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.046878 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.047148 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] PATH_INFO: `/v3/projects/0201f20f8a2e46e6a8ceb7bccf7659df` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.048349 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0201f20f8a2e46e6a8ceb7bccf7659df)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:24.050399 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:24.152224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0201f20f8a2e46e6a8ceb7bccf7659df', 'request_id': 'req-d8e2ce14-079f-418b-b30d-714933b6c010'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:24.159347 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0201f20f8a2e46e6a8ceb7bccf7659df', 'request_id': 'req-d8e2ce14-079f-418b-b30d-714933b6c010'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:24.165419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0201f20f8a2e46e6a8ceb7bccf7659df', 'request_id': 'req-d8e2ce14-079f-418b-b30d-714933b6c010'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:24.251692 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] The token cache is being invalidate because project 0201f20f8a2e46e6a8ceb7bccf7659df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:24.251903 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:24.252539 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-d8e2ce14-079f-418b-b30d-714933b6c010 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:24.254124 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1401/2788] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:29:23 2021] DELETE /identity/v3/projects/0201f20f8a2e46e6a8ceb7bccf7659df => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:24.260268 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2d459-1ea6-4977-97c9-2bade867a8d7 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.260612 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2d459-1ea6-4977-97c9-2bade867a8d7 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.260785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2d459-1ea6-4977-97c9-2bade867a8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.279749 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-fdb2d459-1ea6-4977-97c9-2bade867a8d7 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:24.280968 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-fdb2d459-1ea6-4977-97c9-2bade867a8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:24.343286 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1388/2789] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:29:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:24.351320 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8d9a7-7e55-4441-8119-34a38516e5a0 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.351610 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8d9a7-7e55-4441-8119-34a38516e5a0 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.351885 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8d9a7-7e55-4441-8119-34a38516e5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.370928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-85c8d9a7-7e55-4441-8119-34a38516e5a0 None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:24.372210 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-85c8d9a7-7e55-4441-8119-34a38516e5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:24.380422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1402/2790] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:29:24 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:24.385044 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2d459-1ea6-4977-97c9-2bade867a8d7 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:24.395011 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2d459-1ea6-4977-97c9-2bade867a8d7 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:24.399638 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950f216-36c3-46e1-93f3-edea7ea55559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:24.400945 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950f216-36c3-46e1-93f3-edea7ea55559 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.401219 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950f216-36c3-46e1-93f3-edea7ea55559 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.401493 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950f216-36c3-46e1-93f3-edea7ea55559 admin admin] PATH_INFO: `/v3/domains` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.402270 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950f216-36c3-46e1-93f3-edea7ea55559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=79890) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 27 01:29:24.402573 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950f216-36c3-46e1-93f3-edea7ea55559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:24.404132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950f216-36c3-46e1-93f3-edea7ea55559 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:24.416309 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1389/2791] 10.222.0.32 () {58 vars in 1152 bytes} [Wed Oct 27 01:29:24 2021] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 27 01:29:24.420650 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8d9a7-7e55-4441-8119-34a38516e5a0 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:24.429464 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8d9a7-7e55-4441-8119-34a38516e5a0 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:24.434129 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2626-9b95-4626-bb04-b73945b9ae24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:24.434772 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2626-9b95-4626-bb04-b73945b9ae24 admin admin] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.435044 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2626-9b95-4626-bb04-b73945b9ae24 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.435403 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531e2626-9b95-4626-bb04-b73945b9ae24 admin admin] PATH_INFO: `/v3/projects` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.436016 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e2626-9b95-4626-bb04-b73945b9ae24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:24.445993 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531e2626-9b95-4626-bb04-b73945b9ae24 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:24.515097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1403/2792] 10.222.0.32 () {60 vars in 1152 bytes} [Wed Oct 27 01:29:24 2021] POST /identity/v3/projects => generated 399 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 27 01:29:24.516253 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950f216-36c3-46e1-93f3-edea7ea55559 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:24.527222 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950f216-36c3-46e1-93f3-edea7ea55559 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:24.602275 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9287da-c673-47a8-ae47-ab689562f0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:24.603272 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9287da-c673-47a8-ae47-ab689562f0f3 admin admin] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.603467 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9287da-c673-47a8-ae47-ab689562f0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.604132 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9287da-c673-47a8-ae47-ab689562f0f3 admin admin] PATH_INFO: `/v3/users` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.605075 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9287da-c673-47a8-ae47-ab689562f0f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:24.607023 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9287da-c673-47a8-ae47-ab689562f0f3 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:24.713580 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1390/2793] 10.222.0.32 () {60 vars in 1143 bytes} [Wed Oct 27 01:29:24 2021] POST /identity/v3/users => generated 300 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 27 01:29:24.714900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2626-9b95-4626-bb04-b73945b9ae24 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:24.725238 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531e2626-9b95-4626-bb04-b73945b9ae24 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:24.733216 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5697f-4c87-47d0-acf6-4cc168c3337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:24.733890 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5697f-4c87-47d0-acf6-4cc168c3337b admin admin] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.734245 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5697f-4c87-47d0-acf6-4cc168c3337b admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.734525 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f5697f-4c87-47d0-acf6-4cc168c3337b admin admin] PATH_INFO: `/v3/roles` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.735284 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5697f-4c87-47d0-acf6-4cc168c3337b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:24.736947 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f5697f-4c87-47d0-acf6-4cc168c3337b admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:24.748231 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1404/2794] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:29:24 2021] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:24.752212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9287da-c673-47a8-ae47-ab689562f0f3 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:24.763342 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9287da-c673-47a8-ae47-ab689562f0f3 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:24.768205 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01e94e3-acf1-4863-94dd-ed8a6646ef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:24.768822 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e94e3-acf1-4863-94dd-ed8a6646ef78 admin admin] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.769109 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e94e3-acf1-4863-94dd-ed8a6646ef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.769382 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01e94e3-acf1-4863-94dd-ed8a6646ef78 admin admin] PATH_INFO: `/v3/roles` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.770135 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e94e3-acf1-4863-94dd-ed8a6646ef78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:24.771713 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01e94e3-acf1-4863-94dd-ed8a6646ef78 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:24.783348 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1391/2795] 10.222.0.32 () {58 vars in 1121 bytes} [Wed Oct 27 01:29:24 2021] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 27 01:29:24.790293 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5697f-4c87-47d0-acf6-4cc168c3337b admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:24.797875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f5697f-4c87-47d0-acf6-4cc168c3337b admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:24.802422 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17d79-c066-4cd7-acc5-1bc82f2d492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:24.803327 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17d79-c066-4cd7-acc5-1bc82f2d492a admin admin] REQUEST_METHOD: `PUT` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.807288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17d79-c066-4cd7-acc5-1bc82f2d492a admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.807288 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17d79-c066-4cd7-acc5-1bc82f2d492a admin admin] PATH_INFO: `/v3/projects/ae6d49bde32b438a9687b62f4a7b45e6/users/9a769d550fb14858a27680c1f9c4efff/roles/7800e44cf9cf448aa2ca1ae7e79fe128` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.819669 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad17d79-c066-4cd7-acc5-1bc82f2d492a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae6d49bde32b438a9687b62f4a7b45e6, user_id=9a769d550fb14858a27680c1f9c4efff, role_id=7800e44cf9cf448aa2ca1ae7e79fe128)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:24.823021 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad17d79-c066-4cd7-acc5-1bc82f2d492a admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:24.899150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1405/2796] 10.222.0.32 () {60 vars in 1482 bytes} [Wed Oct 27 01:29:24 2021] PUT /identity/v3/projects/ae6d49bde32b438a9687b62f4a7b45e6/users/9a769d550fb14858a27680c1f9c4efff/roles/7800e44cf9cf448aa2ca1ae7e79fe128 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:24.909965 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5e68-6aab-4d87-8d54-c6b05107cf87 None None] REQUEST_METHOD: `POST` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:24.910379 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5e68-6aab-4d87-8d54-c6b05107cf87 None None] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:24.910828 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5e68-6aab-4d87-8d54-c6b05107cf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:24.940107 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.auth.core [None req-24be5e68-6aab-4d87-8d54-c6b05107cf87 None None] MFA Rules not processed for user `9a769d550fb14858a27680c1f9c4efff`. Rule list: `[]` (Enabled: `True`). {{(pid=79890) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:24.941316 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-24be5e68-6aab-4d87-8d54-c6b05107cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:25.012961 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1392/2797] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:29:24 2021] POST /identity/v3/auth/tokens => generated 3419 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 27 01:29:25.024184 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17d79-c066-4cd7-acc5-1bc82f2d492a admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:25.030244 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-aad17d79-c066-4cd7-acc5-1bc82f2d492a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:25.088387 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17d79-c066-4cd7-acc5-1bc82f2d492a admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:25.092086 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c8383-1f23-4a13-8bb1-3df39050bf6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6d490db0d91a4426930130a4f83f7bc7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:25.092723 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c8383-1f23-4a13-8bb1-3df39050bf6d service cinder] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:25.093002 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c8383-1f23-4a13-8bb1-3df39050bf6d service cinder] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:25.093272 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c8383-1f23-4a13-8bb1-3df39050bf6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:25.101858 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c8383-1f23-4a13-8bb1-3df39050bf6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:25.103370 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c8383-1f23-4a13-8bb1-3df39050bf6d service cinder] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:25.112733 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1406/2798] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:29:25 2021] GET /identity/v3/auth/tokens => generated 3419 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:29.395098 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be5e68-6aab-4d87-8d54-c6b05107cf87 None None] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:29.396531 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-24be5e68-6aab-4d87-8d54-c6b05107cf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:29.459144 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be5e68-6aab-4d87-8d54-c6b05107cf87 None None] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:29.464166 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:29.465049 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:29.465352 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:29.465624 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] PATH_INFO: `/v3/users/af5e8cd9e794460f805ce9e5b70edd32` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:29.466862 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] RBAC: Authorizing `identity:delete_user(user_id=af5e8cd9e794460f805ce9e5b70edd32)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:29.468827 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:29.755336 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af5e8cd9e794460f805ce9e5b70edd32'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:29.767118 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af5e8cd9e794460f805ce9e5b70edd32'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:29.773641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af5e8cd9e794460f805ce9e5b70edd32'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:29.774332 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af5e8cd9e794460f805ce9e5b70edd32'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:29.857092 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af5e8cd9e794460f805ce9e5b70edd32'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:29.863147 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1393/2799] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:29:29 2021] DELETE /identity/v3/users/af5e8cd9e794460f805ce9e5b70edd32 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:30.093556 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c8383-1f23-4a13-8bb1-3df39050bf6d service cinder] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:30.104974 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c8383-1f23-4a13-8bb1-3df39050bf6d service cinder] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:30.159594 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:30.160439 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:30.160717 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:30.160987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] PATH_INFO: `/v3/projects/71d6d08d1ae14a628663fb4124cfccc2` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:30.162186 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d6d08d1ae14a628663fb4124cfccc2)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:30.164072 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:30.274338 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d6d08d1ae14a628663fb4124cfccc2', 'request_id': 'req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.280508 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d6d08d1ae14a628663fb4124cfccc2', 'request_id': 'req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.286126 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d6d08d1ae14a628663fb4124cfccc2', 'request_id': 'req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.365211 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] The token cache is being invalidate because project 71d6d08d1ae14a628663fb4124cfccc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:30.365498 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.366150 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.367706 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1407/2800] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:29:30 2021] DELETE /identity/v3/projects/71d6d08d1ae14a628663fb4124cfccc2 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:30.372343 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:30.373710 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:30.387282 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955ccce-6abc-4d09-8f79-2310341ed73f admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:30.440906 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:30.441759 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:30.442055 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:30.442325 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] PATH_INFO: `/v3/users/939ef019d4204a64bb8273145e6a8fa1` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:30.443504 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=939ef019d4204a64bb8273145e6a8fa1)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:30.445376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:30.632080 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '939ef019d4204a64bb8273145e6a8fa1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.644136 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '939ef019d4204a64bb8273145e6a8fa1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.651150 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '939ef019d4204a64bb8273145e6a8fa1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.651823 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '939ef019d4204a64bb8273145e6a8fa1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.702917 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '939ef019d4204a64bb8273145e6a8fa1'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:30.709124 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1394/2801] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:29:30 2021] DELETE /identity/v3/users/939ef019d4204a64bb8273145e6a8fa1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:30.973483 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:30.974978 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:30.990380 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e13bc0-ead3-48dc-b618-1d0cfbc24e48 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:31.048834 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:31.049678 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:31.049951 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:31.050258 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] PATH_INFO: `/v3/projects/09ce70adca1d41049501286314f0bd94` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:31.051485 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09ce70adca1d41049501286314f0bd94)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:31.053366 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:31.154113 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09ce70adca1d41049501286314f0bd94', 'request_id': 'req-60fcee85-b4eb-4610-90d5-1d76747d3c65'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.160051 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09ce70adca1d41049501286314f0bd94', 'request_id': 'req-60fcee85-b4eb-4610-90d5-1d76747d3c65'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.165240 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09ce70adca1d41049501286314f0bd94', 'request_id': 'req-60fcee85-b4eb-4610-90d5-1d76747d3c65'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.261975 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] The token cache is being invalidate because project 09ce70adca1d41049501286314f0bd94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:31.262203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.262816 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-60fcee85-b4eb-4610-90d5-1d76747d3c65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:31.264335 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1408/2802] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:29:30 2021] DELETE /identity/v3/projects/09ce70adca1d41049501286314f0bd94 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:29:34.176577 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:34.177990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:34.190669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820189d2-4c2c-4f4a-9906-f87ca6304b2c admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:34.245902 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:34.246785 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:34.247059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:34.247327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] PATH_INFO: `/v3/users/9a769d550fb14858a27680c1f9c4efff` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:34.248627 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a769d550fb14858a27680c1f9c4efff)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:34.250543 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:34.476825 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a769d550fb14858a27680c1f9c4efff'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:34.488241 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a769d550fb14858a27680c1f9c4efff'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:34.494667 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a769d550fb14858a27680c1f9c4efff'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:34.498796 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a769d550fb14858a27680c1f9c4efff'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:34.571596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a769d550fb14858a27680c1f9c4efff'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:34.578562 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1395/2803] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:29:34 2021] DELETE /identity/v3/users/9a769d550fb14858a27680c1f9c4efff => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:29:34.583281 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30646ad9-b332-4142-b139-79b5b410990f None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:34.583793 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30646ad9-b332-4142-b139-79b5b410990f None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:34.583901 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30646ad9-b332-4142-b139-79b5b410990f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:34.602019 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-30646ad9-b332-4142-b139-79b5b410990f None None] MFA Rules not processed for user `5c3a6c2e10d54dfc8b895992ac771847`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:29:34.603267 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-30646ad9-b332-4142-b139-79b5b410990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:34.659750 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1409/2804] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:29:34 2021] POST /identity/v3/auth/tokens => generated 3382 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:29:34.669693 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:34.671091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:34.725679 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df15dc4b-841a-43b4-8435-5cba2ad11b08 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:34.729369 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548ab1f-d3f0-4412-b71b-348170306498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:34.729938 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548ab1f-d3f0-4412-b71b-348170306498 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:34.730248 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548ab1f-d3f0-4412-b71b-348170306498 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:34.730519 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548ab1f-d3f0-4412-b71b-348170306498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:34.739093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548ab1f-d3f0-4412-b71b-348170306498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:34.740484 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548ab1f-d3f0-4412-b71b-348170306498 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:34.750112 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1396/2805] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:29:34 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:29:35.185017 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30646ad9-b332-4142-b139-79b5b410990f None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:29:35.186581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-30646ad9-b332-4142-b139-79b5b410990f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:29:35.199991 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30646ad9-b332-4142-b139-79b5b410990f None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:29:35.204582 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:29:35.205745 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:29:35.205900 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:29:35.206203 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] PATH_INFO: `/v3/projects/ae6d49bde32b438a9687b62f4a7b45e6` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:29:35.208101 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae6d49bde32b438a9687b62f4a7b45e6)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:29:35.210111 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:29:35.365929 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae6d49bde32b438a9687b62f4a7b45e6', 'request_id': 'req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:35.372015 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae6d49bde32b438a9687b62f4a7b45e6', 'request_id': 'req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:35.377230 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae6d49bde32b438a9687b62f4a7b45e6', 'request_id': 'req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:35.462309 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] The token cache is being invalidate because project ae6d49bde32b438a9687b62f4a7b45e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:29:35.462598 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:35.463756 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-465ec95d-23f7-41ac-8ef0-c8bc5723ab6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:29:35.465429 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1410/2806] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:29:35 2021] DELETE /identity/v3/projects/ae6d49bde32b438a9687b62f4a7b45e6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:30:24.838202 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548ab1f-d3f0-4412-b71b-348170306498 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:24.839699 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-a548ab1f-d3f0-4412-b71b-348170306498 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:24.852123 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548ab1f-d3f0-4412-b71b-348170306498 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:24.899897 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:24.900535 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:24.900812 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:24.901082 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:24.903327 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:24.913304 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:24.914742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:24.922561 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1397/2807] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:30:24 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:50.521224 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85565-2ae6-40a2-a8f9-2f5d028ee169 None None] REQUEST_METHOD: `POST` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:50.521764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85565-2ae6-40a2-a8f9-2f5d028ee169 None None] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:50.521764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb85565-2ae6-40a2-a8f9-2f5d028ee169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:50.539532 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.auth.core [None req-afb85565-2ae6-40a2-a8f9-2f5d028ee169 None None] MFA Rules not processed for user `eb7fe651d1c84f28a9267a543d0e2497`. Rule list: `[]` (Enabled: `True`). {{(pid=79889) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 27 01:30:50.540719 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-afb85565-2ae6-40a2-a8f9-2f5d028ee169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:50.592689 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1411/2808] 10.222.0.32 () {58 vars in 957 bytes} [Wed Oct 27 01:30:50 2021] POST /identity/v3/auth/tokens => generated 3397 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 27 01:30:50.896806 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:50.898248 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:50.916411 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf0f8eb-bb33-4e76-89d0-0f0b045fe8db service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:50.921356 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375e66a-731c-4ec1-a240-3ef115e36269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:50.922038 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375e66a-731c-4ec1-a240-3ef115e36269 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:50.922408 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375e66a-731c-4ec1-a240-3ef115e36269 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:50.922688 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9375e66a-731c-4ec1-a240-3ef115e36269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:50.924418 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-9375e66a-731c-4ec1-a240-3ef115e36269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:50.934260 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375e66a-731c-4ec1-a240-3ef115e36269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:50.935758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9375e66a-731c-4ec1-a240-3ef115e36269 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:50.944064 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1398/2809] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:30:50 2021] GET /identity/v3/auth/tokens => generated 3264 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:52.913192 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb85565-2ae6-40a2-a8f9-2f5d028ee169 None None] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:52.914658 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-afb85565-2ae6-40a2-a8f9-2f5d028ee169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:52.981077 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb85565-2ae6-40a2-a8f9-2f5d028ee169 None None] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:52.986875 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8df6e02fde834883aef230f31d6ecd94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:52.987533 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:52.987812 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:52.988083 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:52.990134 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:53.001987 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:53.003563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:53.013988 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1412/2810] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:30:52 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:58.425983 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375e66a-731c-4ec1-a240-3ef115e36269 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:58.434515 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9375e66a-731c-4ec1-a240-3ef115e36269 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:58.438139 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f2bf-a2c1-4fde-a3f9-f16d2b0514c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:58.438767 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f2bf-a2c1-4fde-a3f9-f16d2b0514c2 service neutron] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:58.439044 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f2bf-a2c1-4fde-a3f9-f16d2b0514c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:58.439311 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5f2bf-a2c1-4fde-a3f9-f16d2b0514c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:58.441163 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b9a5f2bf-a2c1-4fde-a3f9-f16d2b0514c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:58.453376 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5f2bf-a2c1-4fde-a3f9-f16d2b0514c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:58.459718 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5f2bf-a2c1-4fde-a3f9-f16d2b0514c2 service neutron] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:58.463993 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1399/2811] 10.222.0.32 () {60 vars in 1396 bytes} [Wed Oct 27 01:30:58 2021] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3397 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:30:59.559964 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:30:59.562226 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:59.658403 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd5290-f918-4225-98e9-8397fac9ac16 service placement] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:30:59.665097 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9e07c-82b9-4e2c-a372-461280ca2492 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:30:59.665764 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e07c-82b9-4e2c-a372-461280ca2492 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:30:59.666062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e07c-82b9-4e2c-a372-461280ca2492 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:30:59.666538 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde9e07c-82b9-4e2c-a372-461280ca2492 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:30:59.668371 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-fde9e07c-82b9-4e2c-a372-461280ca2492 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:30:59.681567 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9e07c-82b9-4e2c-a372-461280ca2492 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:30:59.683222 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde9e07c-82b9-4e2c-a372-461280ca2492 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:30:59.695477 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1413/2812] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:30:59 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 27 01:31:10.449375 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f2bf-a2c1-4fde-a3f9-f16d2b0514c2 service neutron] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:31:10.461596 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5f2bf-a2c1-4fde-a3f9-f16d2b0514c2 service neutron] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:31:10.467449 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899fa01-520e-4dfc-acee-ecd1d1927b53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:31:10.468072 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899fa01-520e-4dfc-acee-ecd1d1927b53 service nova] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:31:10.468349 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899fa01-520e-4dfc-acee-ecd1d1927b53 service nova] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:31:10.468669 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899fa01-520e-4dfc-acee-ecd1d1927b53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:31:10.470446 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-2899fa01-520e-4dfc-acee-ecd1d1927b53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:31:10.482059 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899fa01-520e-4dfc-acee-ecd1d1927b53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:31:10.487199 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899fa01-520e-4dfc-acee-ecd1d1927b53 service nova] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:31:10.494318 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1400/2813] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:31:10 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:42.362526 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9e07c-82b9-4e2c-a372-461280ca2492 service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:42.435022 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde9e07c-82b9-4e2c-a372-461280ca2492 service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:42.440595 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d55c0-3275-4654-b4f1-758146ab2994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1596a916d784f6bb6e3b876f4820903', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'ResellerAdmin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:42.443928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d55c0-3275-4654-b4f1-758146ab2994 service nova] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:42.443928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d55c0-3275-4654-b4f1-758146ab2994 service nova] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:42.443928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d55c0-3275-4654-b4f1-758146ab2994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:42.443928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-240d55c0-3275-4654-b4f1-758146ab2994 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:42.478116 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d55c0-3275-4654-b4f1-758146ab2994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:42.479608 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d55c0-3275-4654-b4f1-758146ab2994 service nova] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:42.490461 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1414/2814] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:42 2021] GET /identity/v3/auth/tokens => generated 3515 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:45.914595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899fa01-520e-4dfc-acee-ecd1d1927b53 service nova] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:45.971568 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899fa01-520e-4dfc-acee-ecd1d1927b53 service nova] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:45.976646 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8df6e02fde834883aef230f31d6ecd94', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:45.977283 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] REQUEST_METHOD: `GET` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:45.977565 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:45.977837 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:45.979595 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:46.003091 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:46.004641 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:46.015258 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1401/2815] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:45 2021] GET /identity/v3/auth/tokens => generated 3451 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:32:58.020478 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d55c0-3275-4654-b4f1-758146ab2994 service nova] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:32:58.039470 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d55c0-3275-4654-b4f1-758146ab2994 service nova] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:32:58.043033 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91641fa-4e72-4e5b-8f9e-9f3d0b87a378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '66c74b04afed4aabbdbee054438a4933', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0a888473e9774db39941b0610769505a', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:32:58.043666 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91641fa-4e72-4e5b-8f9e-9f3d0b87a378 service neutron] REQUEST_METHOD: `GET` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:32:58.043940 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91641fa-4e72-4e5b-8f9e-9f3d0b87a378 service neutron] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:32:58.044207 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91641fa-4e72-4e5b-8f9e-9f3d0b87a378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:32:58.046634 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-a91641fa-4e72-4e5b-8f9e-9f3d0b87a378 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:32:58.125176 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91641fa-4e72-4e5b-8f9e-9f3d0b87a378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:32:58.126541 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91641fa-4e72-4e5b-8f9e-9f3d0b87a378 service neutron] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:32:58.144701 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1415/2816] 10.222.0.32 () {60 vars in 1365 bytes} [Wed Oct 27 01:32:58 2021] GET /identity/v3/auth/tokens => generated 3382 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 27 01:33:05.122631 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:05.124122 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:05.137392 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b43a1-fb92-4497-80af-dba2611e617b service placement] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:05.142852 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:05.143712 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:05.143992 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:05.144266 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] PATH_INFO: `/v3/users/eb7fe651d1c84f28a9267a543d0e2497` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:05.145454 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb7fe651d1c84f28a9267a543d0e2497)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:05.147384 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:05.301517 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb7fe651d1c84f28a9267a543d0e2497'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.313544 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb7fe651d1c84f28a9267a543d0e2497'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.320212 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb7fe651d1c84f28a9267a543d0e2497'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.320873 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb7fe651d1c84f28a9267a543d0e2497'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.395261 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb7fe651d1c84f28a9267a543d0e2497'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.401471 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1402/2817] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:05 2021] DELETE /identity/v3/users/eb7fe651d1c84f28a9267a543d0e2497 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:05.642928 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91641fa-4e72-4e5b-8f9e-9f3d0b87a378 service neutron] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:05.652514 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91641fa-4e72-4e5b-8f9e-9f3d0b87a378 service neutron] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:05.707062 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:05.707945 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:05.708215 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:05.708481 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] PATH_INFO: `/v3/projects/80ccd2038569468b9d4f7a063fb346c9` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:05.709652 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80ccd2038569468b9d4f7a063fb346c9)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:05.711581 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:05.834563 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80ccd2038569468b9d4f7a063fb346c9', 'request_id': 'req-36eb4789-0869-4fdb-bafa-2f47b9f95371'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.840803 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80ccd2038569468b9d4f7a063fb346c9', 'request_id': 'req-36eb4789-0869-4fdb-bafa-2f47b9f95371'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.846256 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80ccd2038569468b9d4f7a063fb346c9', 'request_id': 'req-36eb4789-0869-4fdb-bafa-2f47b9f95371'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.942686 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] The token cache is being invalidate because project 80ccd2038569468b9d4f7a063fb346c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:05.942967 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.943593 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:05.945112 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1416/2818] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:05 2021] DELETE /identity/v3/projects/80ccd2038569468b9d4f7a063fb346c9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 27 01:33:05.949031 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] Authenticating user token {{(pid=79890) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:05.950428 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.fernet_utils [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79890) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:05.963742 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ba3c8-3535-4655-b998-12bd1d5e8e91 admin admin] Validating token access rules against request {{(pid=79890) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:06.019191 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79890) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:06.020049 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:06.020417 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:06.020585 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] PATH_INFO: `/v3/users/fed43b17626b4031999d65ac4840f079` {{(pid=79890) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:06.021758 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed43b17626b4031999d65ac4840f079)` {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:06.023695 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] RBAC: Authorization granted {{(pid=79890) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:06.253093 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed43b17626b4031999d65ac4840f079'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.264189 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed43b17626b4031999d65ac4840f079'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.270990 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed43b17626b4031999d65ac4840f079'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.271664 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed43b17626b4031999d65ac4840f079'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.351249 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: DEBUG keystone.notifications [None req-dc52b198-b245-4e42-81fb-0420463709b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed43b17626b4031999d65ac4840f079'} {{(pid=79890) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.357333 dv-cinder-815560-1-iscsi devstack@keystone.service[79890]: [pid: 79890|app: 0|req: 1403/2819] 10.222.0.32 () {58 vars in 1223 bytes} [Wed Oct 27 01:33:05 2021] DELETE /identity/v3/users/fed43b17626b4031999d65ac4840f079 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 27 01:33:06.590744 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] Authenticating user token {{(pid=79889) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 27 01:33:06.592216 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.fernet_utils [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=79889) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 27 01:33:06.606008 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eb4789-0869-4fdb-bafa-2f47b9f95371 admin admin] Validating token access rules against request {{(pid=79889) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 27 01:33:06.662523 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c3a6c2e10d54dfc8b895992ac771847', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3355962a746e4ae38c08a8001aa0f51d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=79889) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 27 01:33:06.663365 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] REQUEST_METHOD: `DELETE` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 27 01:33:06.663641 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] SCRIPT_NAME: `/identity` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 27 01:33:06.663908 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] PATH_INFO: `/v3/projects/b39641b3f9f54f608fa97e28dd1aa1fd` {{(pid=79889) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 27 01:33:06.665068 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39641b3f9f54f608fa97e28dd1aa1fd)` {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 27 01:33:06.666992 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] RBAC: Authorization granted {{(pid=79889) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 27 01:33:06.779419 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39641b3f9f54f608fa97e28dd1aa1fd', 'request_id': 'req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.785850 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39641b3f9f54f608fa97e28dd1aa1fd', 'request_id': 'req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.790971 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39641b3f9f54f608fa97e28dd1aa1fd', 'request_id': 'req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d'} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.899053 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] The token cache is being invalidate because project b39641b3f9f54f608fa97e28dd1aa1fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=79889) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 27 01:33:06.899337 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.899935 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: DEBUG keystone.notifications [None req-723c1b97-ff2d-4a7f-93d7-7229ddf4f58d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=79889) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 27 01:33:06.901444 dv-cinder-815560-1-iscsi devstack@keystone.service[79889]: [pid: 79889|app: 0|req: 1417/2820] 10.222.0.32 () {58 vars in 1232 bytes} [Wed Oct 27 01:33:06 2021] DELETE /identity/v3/projects/b39641b3f9f54f608fa97e28dd1aa1fd => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0)